Jul 29 06:22:36.676320 ip-10-0-133-7 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 06:22:37.089960 ip-10-0-133-7 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 06:22:37.089960 ip-10-0-133-7 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 06:22:37.089960 ip-10-0-133-7 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 06:22:37.089960 ip-10-0-133-7 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 06:22:37.089960 ip-10-0-133-7 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 06:22:37.090777 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.090692    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 06:22:37.094933 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094917    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 06:22:37.094933 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094933    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094936    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094940    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094943    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094945    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094950    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094954    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094958    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094960    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094963    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094966    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094969    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094981    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094984    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094986    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094989    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094991    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094994    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094996    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.094999    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 06:22:37.095000 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095016    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095019    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095022    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095025    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095028    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095030    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095033    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095036    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095038    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095041    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095043    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095046    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095048    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095051    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095053    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095056    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095058    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095060    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095063    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095065    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 06:22:37.095483 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095067    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095070    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095072    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095075    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095077    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095081    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095085    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095088    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095091    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095094    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095096    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095099    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095101    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095104    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095108    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095111    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095113    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095116    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095118    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 06:22:37.095985 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095121    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095123    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095126    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095129    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095132    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095136    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095139    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095142    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095144    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095147    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095149    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095152    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095155    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095157    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095160    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095162    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095166    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095168    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095171    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 06:22:37.096555 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095173    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095176    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095179    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095181    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095184    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095186    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095189    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095191    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095195    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095197    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095200    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095202    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095205    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095207    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095210    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095212    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095215    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095217    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095220    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095222    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 06:22:37.097020 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095960    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095967    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095969    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095973    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095975    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095978    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095980    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095983    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095986    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095991    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095995    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.095998    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096015    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096022    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096025    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096028    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096031    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096034    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096036    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096039    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 06:22:37.097496 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096042    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096045    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096047    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096050    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096052    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096055    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096057    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096059    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096062    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096064    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096067    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096070    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096072    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096075    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096077    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096079    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096082    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096084    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096086    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096089    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 06:22:37.098017 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096091    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096094    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096096    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096100    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096102    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096104    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096107    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096110    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096112    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096115    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096117    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096120    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096123    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096125    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096128    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096130    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096133    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096135    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096138    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096140    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 06:22:37.098559 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096142    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096145    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096147    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096150    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096152    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096154    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096157    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096160    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096162    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096164    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096166    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096169    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096172    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096174    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096176    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096179    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096182    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096186    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096188    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 06:22:37.099061 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096192    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096195    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096198    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096203    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096208    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096211    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096213    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096216    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096218    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096221    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096224    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096226    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096229    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096231    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096234    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096236    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096239    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096241    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096244    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 06:22:37.099514 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096246    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096609    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096614    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096619    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096621    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096624    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096626    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096629    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096631    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096634    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096637    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096640    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096642    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096645    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096648    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096651    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096654    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096656    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096659    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096661    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 06:22:37.099973 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096664    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096666    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096669    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096671    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096674    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096676    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096679    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096681    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096684    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096686    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096689    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096691    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096694    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096696    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096699    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096701    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096704    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096707    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096709    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 06:22:37.100474 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096711    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096714    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096716    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096722    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096724    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096726    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096729    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096732    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096734    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096737    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096740    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096742    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096744    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096747    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096750    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096752    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096755    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096757    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096760    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096762    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 06:22:37.100943 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096764    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096767    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096769    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096773    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096777    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096780    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096782    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096785    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096787    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096790    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096793    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096795    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096797    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096800    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096803    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096806    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096809    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096811    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096815    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 06:22:37.101435 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096818    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096822    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096825    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096828    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096830    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096833    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096835    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096839    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096842    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096844    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096846    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096849    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096852    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096855    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096857    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096860    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096862    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096864    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096867    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096869    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 06:22:37.101886 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096872    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.096874    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096948    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096955    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096961    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096965    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096971    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096974    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096979    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096983    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096987    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096990    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096994    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.096997    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097014    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097018    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097021    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097024    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097027    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097030    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097035    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097037    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097040    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097043    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 06:22:37.102368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097046    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097050    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097053    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097056    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097059    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097062    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097064    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097067    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097070    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097073    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097076    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097079    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097082    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097085    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097090    2578 flags.go:64] FLAG: --enable-server="true"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097092    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097097    2578 flags.go:64] FLAG: --event-burst="100"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097100    2578 flags.go:64] FLAG: --event-qps="50"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097103    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097106    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097109    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097112    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097115    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097118    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097121    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 29 06:22:37.102935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097124    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097126    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097129    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097132    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097135    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097137    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097140    2578 flags.go:64] FLAG: --feature-gates=""
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097144    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097147    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097150    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097152    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097155    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097158    2578 flags.go:64] FLAG: --help="false"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097161    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097164    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097166    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097169    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097172    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097175    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097178    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097180    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097184    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097186    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 06:22:37.103562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097189    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097192    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097195    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097198    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097201    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097204    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097206    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097209    2578 flags.go:64] FLAG: --lock-file=""
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097212    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097215    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097218    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097223    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097226    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097229    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097232    2578 flags.go:64] FLAG: --logging-format="text"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097234    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097237    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097240    2578 flags.go:64] FLAG: --manifest-url=""
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097243    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097247    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097250    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097253    2578 flags.go:64] FLAG: --max-pods="110"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097256    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097259    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097261    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 06:22:37.104245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097264    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097267    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097270    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097272    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097279    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097283    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097286    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097289    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097292    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097298    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097301    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097304    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097307    2578 flags.go:64] FLAG: --port="10250"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097310    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097313    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c868d196f0de0f5"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097316    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097320    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097323    2578 flags.go:64] FLAG: --register-node="true"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097325    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097329    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097331    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097334    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097336    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097340    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097342    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 06:22:37.105163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097345    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097348    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097350    2578 flags.go:64] FLAG: --runonce="false"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097353    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097356    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097359    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097361    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097365    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097368    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097370    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097373    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097376    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097380    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097382    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097385    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097388    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097391    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097394    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097398    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097401    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097404    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097408    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097410    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097413    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097416    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 06:22:37.105920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097419    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097422    2578 flags.go:64] FLAG: --v="2"
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097425    2578 flags.go:64] FLAG: --version="false"
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097429    2578 flags.go:64] FLAG: --vmodule=""
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097437    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097440    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097559    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097562    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097565    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097568    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097571    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097573    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097576    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097578    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097581    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097583    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097585    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097588    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097590    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097594    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 06:22:37.106545 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097596    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097599    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097603    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097606    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097608    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097611    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097613    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097616    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097618    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097621    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097623    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097626    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097629    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097631    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097634    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097636    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097639    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097641    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097643    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097646    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 06:22:37.107038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097648    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097650    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097653    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097655    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097657    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097660    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097662    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097665    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097667    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097670    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097672    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097676    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097678    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097680    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097684    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097687    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097689    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097692    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097694    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 06:22:37.107521 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097697    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097699    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097702    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097704    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097707    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097709    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097712    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097714    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097717    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097719    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097722    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097724    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097727    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097731    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097734    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097737    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097740    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097742    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097744    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 06:22:37.108124 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097747    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097751    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097754    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097756    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097759    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097763    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097765    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097769    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097774    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097777    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097780    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097783    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097786    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097788    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097791    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097793    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097796    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097798    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097801    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 06:22:37.108590 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097803    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097806    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097809    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097811    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097814    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097816    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097819    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.097821    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.097829    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.106147    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.106163    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.106185    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.106194    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106253    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106258    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 06:22:37.109053 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106261    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106264    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106267    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106270    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106272    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106275    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106278    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106280    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106283    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106285    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106288    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106291    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106293    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106296    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106299    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106301    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106305    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106308    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106312    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106315    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 06:22:37.109422 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106318    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106321    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106324    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106327    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106329    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106332    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106334    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106338    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106340    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106343    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106346    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106348    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106350    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106353    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106356    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106358    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106361    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106363    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106365    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 06:22:37.109900 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106368    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106370    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106373    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106376    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106378    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106380    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106383    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106386    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106388    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106390    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106393    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106395    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106398    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106402    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106405    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106408    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106411    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106414    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106417    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106419    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 06:22:37.110367 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106422    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106425    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106428    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106430    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106433    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106435    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106438    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106440    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106443    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106445    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106448    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106450    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106453    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106456    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106458    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106462    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106465    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106468    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106471    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 06:22:37.110890 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106474    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106476    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106478    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106481    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106484    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106486    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106488    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106491    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106494    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106496    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106498    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106501    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106503    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106507    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106509    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106512    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106514    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106517    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 06:22:37.111376 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106520    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.106525    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106651    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106656    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106659    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106662    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106664    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106667    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106670    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106673    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106676    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106678    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106681    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106684    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106687    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 06:22:37.111835 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106690    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106692    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106695    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106697    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106700    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106703    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106705    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106708    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106710    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106713    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106715    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106718    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106721    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106724    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106726    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106729    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106731    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106735    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106738    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 06:22:37.112377 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106740    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106743    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106745    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106748    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106750    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106752    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106755    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106757    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106760    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106762    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106766    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106769    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106772    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106775    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106778    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106781    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106783    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106786    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106789    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 06:22:37.112839 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106792    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106794    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106796    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106799    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106801    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106803    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106806    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106809    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106811    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106814    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106816    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106818    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106821    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106823    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106826    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106828    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106831    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106833    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106835    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106838    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 06:22:37.113587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106840    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106843    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106845    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106847    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106850    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106852    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106855    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106858    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106860    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106863    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106865    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106867    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106870    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106872    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106874    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106877    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106879    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106882    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106885    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106887    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106889    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 06:22:37.114183 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106892    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106894    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106897    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106899    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106901    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106904    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:37.106908    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.106913    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.107047    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.110717    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.111945    2578 server.go:1019] "Starting client certificate rotation"
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.112064    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.112114    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 06:22:37.114881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.114719    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 06:22:37.115842 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.115820    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 06:22:37.132091 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.132071    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 29 06:22:37.133996 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.133981    2578 log.go:25] "Validated CRI v1 image API"
Jul 29 06:22:37.134897 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.134875    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 06:22:37.137290 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.137272    2578 fs.go:135] Filesystem UUIDs: map[4399dd9b-563e-4f87-9c4f-efa29382d229:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e2af8298-caba-44a4-8ae7-81b05d78ed60:/dev/nvme0n1p3]
Jul 29 06:22:37.137354 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.137289    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 06:22:37.144099 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.143683    2578 manager.go:216] Machine: {Timestamp:2026-07-29 06:22:37.142065757 +0000 UTC m=+0.343360876 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105146 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f282c3eee10b3886f7a7c285f7a7c SystemUUID:ec2f282c-3eee-10b3-886f-7a7c285f7a7c BootID:32c8e857-a4c0-4688-b10e-3f8e9ead88ea Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:78:c6:20:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:78:c6:20:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:0b:d6:07:7c:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 06:22:37.144099 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.144087    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 06:22:37.144253 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.144214    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 06:22:37.147863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.147846    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 06:22:37.148420 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.148396    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 06:22:37.148550 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.148424    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 06:22:37.149115 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.149105    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 06:22:37.149147 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.149118    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 06:22:37.149147 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.149125    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 06:22:37.149798 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.149788    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 06:22:37.150645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.150633    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 06:22:37.152436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152424    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 06:22:37.152549 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152538    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 06:22:37.152586 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152572    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 06:22:37.152586 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152583    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 06:22:37.152642 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152597    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 06:22:37.152642 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152605    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 29 06:22:37.152642 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152616    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 06:22:37.152949 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152936    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 06:22:37.153038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.152955    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 06:22:37.155247 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.155226    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 06:22:37.157165 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.157152    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 06:22:37.157222 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.157182    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 06:22:37.158717 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158704    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 06:22:37.158751 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158726    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 06:22:37.158751 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158734    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 06:22:37.158751 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158739    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 06:22:37.158751 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158748    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158754    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158762    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158767    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158775    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158784    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158798    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 06:22:37.158853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.158804    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 06:22:37.159671 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.159660    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 06:22:37.159671 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.159671    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 06:22:37.161580 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.161534    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 06:22:37.161633 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.161590    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 06:22:37.161633 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.161603    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 06:22:37.162951 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.162939    2578 server.go:1268] "Started kubelet"
Jul 29 06:22:37.163058 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.163031    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 06:22:37.163058 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.163030    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 06:22:37.163145 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.163097    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 06:22:37.163805 ip-10-0-133-7 systemd[1]: Started Kubernetes Kubelet.
Jul 29 06:22:37.165923 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.165906    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 06:22:37.166309 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.166295    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 06:22:37.167579 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.167561    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n7d4t"
Jul 29 06:22:37.169041 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.169024    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 06:22:37.172250 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172234    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 06:22:37.172250 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172235    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 06:22:37.172401 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.172384    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.172760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172739    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n7d4t"
Jul 29 06:22:37.172846 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.171838    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-7.ec2.internal.18c6ae7db1035665  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-7.ec2.internal,UID:ip-10-0-133-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-7.ec2.internal,},FirstTimestamp:2026-07-29 06:22:37.162911333 +0000 UTC m=+0.364206445,LastTimestamp:2026-07-29 06:22:37.162911333 +0000 UTC m=+0.364206445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-7.ec2.internal,}"
Jul 29 06:22:37.172929 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172911    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 06:22:37.172971 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172933    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 06:22:37.173025 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172989    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 06:22:37.173025 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.172998    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 06:22:37.173119 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173039    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 06:22:37.173433 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173395    2578 factory.go:55] Registering systemd factory
Jul 29 06:22:37.173433 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173419    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 29 06:22:37.173644 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173630    2578 factory.go:153] Registering CRI-O factory
Jul 29 06:22:37.173644 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173646    2578 factory.go:223] Registration of the crio container factory successfully
Jul 29 06:22:37.173754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173697    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 06:22:37.173754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173724    2578 factory.go:103] Registering Raw factory
Jul 29 06:22:37.173754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.173739    2578 manager.go:1196] Started watching for new ooms in manager
Jul 29 06:22:37.174286 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.174270    2578 manager.go:349] Starting recovery of all containers
Jul 29 06:22:37.182500 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.182449    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 06:22:37.185409 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.185369    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 06:22:37.186520 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.186501    2578 manager.go:354] Recovery completed
Jul 29 06:22:37.187862 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.187826    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-7.ec2.internal\" not found" node="ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.188180 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.188071    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 06:22:37.191067 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.191053    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.192748 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.192732    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.192804 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.192763    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.192804 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.192774    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.193269 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193257    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 06:22:37.193269 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193267    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.193345 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193267    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 06:22:37.193345 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193299    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 06:22:37.193865 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193849    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.193907 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193878    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.193907 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.193888    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.194793 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.194781    2578 policy_none.go:49] "None policy: Start"
Jul 29 06:22:37.194833 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.194796    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 06:22:37.194833 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.194808    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 06:22:37.195666 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.195656    2578 policy_none.go:47] "Start"
Jul 29 06:22:37.238672 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.238654    2578 manager.go:337] "Starting Device Plugin manager"
Jul 29 06:22:37.238790 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.238688    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 06:22:37.238790 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.238698    2578 server.go:87] "Starting device plugin registration server"
Jul 29 06:22:37.238989 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.238976    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 06:22:37.239206 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.238993    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 06:22:37.239206 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.239134    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 06:22:37.239395 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.239219    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 06:22:37.239395 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.239228    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 06:22:37.240559 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.240539    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 06:22:37.240637 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.240589    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.332173 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.332138    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 06:22:37.332291 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.332187    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 06:22:37.332291 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.332210    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 06:22:37.332291 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.332250    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 06:22:37.335121 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.335098    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 06:22:37.340142 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.340100    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.340936 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.340921    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.340986 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.340950    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.340986 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.340959    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.341101 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.340992    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.349416 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.349400    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.349492 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.349424    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-7.ec2.internal\": node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.368587 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.368565    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.433159 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.433116    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"]
Jul 29 06:22:37.433268 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.433204    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.434179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.434163    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.434246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.434192    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.434246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.434201    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.435549 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.435537    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.435696 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.435676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.435729 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.435719    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.436344 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.436331    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.436419 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.436356    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.436419 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.436368    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.436474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.436335    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.436474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.436442    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.436474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.436455    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.437673 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.437656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.437725 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.437685    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 06:22:37.438418 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.438393    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 06:22:37.438474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.438424    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 06:22:37.438474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.438438    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID"
Jul 29 06:22:37.462644 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.462622    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-7.ec2.internal\" not found" node="ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.466901 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.466886    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-7.ec2.internal\" not found" node="ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.468930 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.468916    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.569560 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.569537    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.574919 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.574902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41261809a518fbe94d34f36a76ff2a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"b41261809a518fbe94d34f36a76ff2a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.574963 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.574927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41261809a518fbe94d34f36a76ff2a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"b41261809a518fbe94d34f36a76ff2a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.575001 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.574964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/549091cca5f0a3b021a686609b790c31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-7.ec2.internal\" (UID: \"549091cca5f0a3b021a686609b790c31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.670354 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.670291    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.675607 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.675592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41261809a518fbe94d34f36a76ff2a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"b41261809a518fbe94d34f36a76ff2a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.675653 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.675615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/549091cca5f0a3b021a686609b790c31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-7.ec2.internal\" (UID: \"549091cca5f0a3b021a686609b790c31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.675653 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.675639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41261809a518fbe94d34f36a76ff2a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"b41261809a518fbe94d34f36a76ff2a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.675728 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.675665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41261809a518fbe94d34f36a76ff2a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"b41261809a518fbe94d34f36a76ff2a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.675728 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.675695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41261809a518fbe94d34f36a76ff2a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"b41261809a518fbe94d34f36a76ff2a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.675728 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.675712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/549091cca5f0a3b021a686609b790c31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-7.ec2.internal\" (UID: \"549091cca5f0a3b021a686609b790c31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.765813 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.765780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.770412 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.770396    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.771511 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:37.771491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:37.870950 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.870911    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:37.971515 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:37.971445    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:38.072022 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:38.071982    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:38.111429 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.111406    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 06:22:38.111906 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.111545    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 06:22:38.111906 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.111572    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 06:22:38.168285 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.168258    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 06:22:38.172491 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:38.172472    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found"
Jul 29 06:22:38.175507 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.175492    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 06:22:38.177194 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.177165    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 06:17:38 +0000 UTC" deadline="2027-12-22 13:08:28.872654764 +0000 UTC"
Jul 29 06:22:38.177237 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.177195    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12270h45m50.695462272s"
Jul 29 06:22:38.272691 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.272662    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:38.283986 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.283964    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 06:22:38.284897 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.284880    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"
Jul 29 06:22:38.291184 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.291166    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 06:22:38.326487 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:38.326450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41261809a518fbe94d34f36a76ff2a6.slice/crio-f13da56ad315cd22d8eb9bf1c674a1ee4c6e4e6b4f4d75955e2a902a523653f9 WatchSource:0}: Error finding container f13da56ad315cd22d8eb9bf1c674a1ee4c6e4e6b4f4d75955e2a902a523653f9: Status 404 returned error can't find the container with id f13da56ad315cd22d8eb9bf1c674a1ee4c6e4e6b4f4d75955e2a902a523653f9
Jul 29 06:22:38.329363 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:38.329332    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549091cca5f0a3b021a686609b790c31.slice/crio-83efe1d713b563257efdd134d5f983c26718f794e6d418ce8d059a8bb2bf3665 WatchSource:0}: Error finding container 83efe1d713b563257efdd134d5f983c26718f794e6d418ce8d059a8bb2bf3665: Status 404 returned error can't find the container with id 83efe1d713b563257efdd134d5f983c26718f794e6d418ce8d059a8bb2bf3665
Jul 29 06:22:38.331460 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.331439    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 06:22:38.335569 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.335530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" event={"ID":"549091cca5f0a3b021a686609b790c31","Type":"ContainerStarted","Data":"83efe1d713b563257efdd134d5f983c26718f794e6d418ce8d059a8bb2bf3665"}
Jul 29 06:22:38.336590 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:38.336572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" event={"ID":"b41261809a518fbe94d34f36a76ff2a6","Type":"ContainerStarted","Data":"f13da56ad315cd22d8eb9bf1c674a1ee4c6e4e6b4f4d75955e2a902a523653f9"}
Jul 29 06:22:40.531161 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.531124    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 06:22:40.719698 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.719624    2578 apiserver.go:52] "Watching apiserver"
Jul 29 06:22:40.726190 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.726164    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 06:22:40.727384 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.727356    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 06:22:40.727794 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.727772    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal","openshift-image-registry/node-ca-cx94n","openshift-multus/multus-6gvdt","openshift-network-diagnostics/network-check-target-gvlsn","openshift-ovn-kubernetes/ovnkube-node-br2sf","kube-system/konnectivity-agent-rgsdl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg","openshift-cluster-node-tuning-operator/tuned-xjq8t","openshift-dns/node-resolver-rtlff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal","openshift-multus/multus-additional-cni-plugins-xwxz7","openshift-multus/network-metrics-daemon-h4557","openshift-network-operator/iptables-alerter-wpk98","kube-system/global-pull-secret-syncer-m7dhw"]
Jul 29 06:22:40.729474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.729455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.730898 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.730882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.732088 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.731962    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4wlg7\""
Jul 29 06:22:40.732088 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.731968    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.732088 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.732082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.732998 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.732980    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.733086 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.733071    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltgbm\""
Jul 29 06:22:40.733203 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.733189    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 06:22:40.733347 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.733321    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.733420 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.733357    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.734286 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.734267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.735308 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.735294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 06:22:40.735547 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.735530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4hsg4\""
Jul 29 06:22:40.735927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.735670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.735927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.735880    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.736188 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.736172    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 06:22:40.736262 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.736241    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.736601 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.736570    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.737011 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.736872    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 06:22:40.737011 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.736908    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.737167 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.737091    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m2jhf\""
Jul 29 06:22:40.737370 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.737353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.737747 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.737734    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvrr2\""
Jul 29 06:22:40.737801 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.737777    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 06:22:40.737879 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.737867    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 06:22:40.738233 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.738216    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 06:22:40.739175 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.738605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.739798 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.739779    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-25nsr\""
Jul 29 06:22:40.739798 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.739792    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 06:22:40.740471 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.739944    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 06:22:40.740471 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.740051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.741355 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.740774    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.741355 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.740878    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9zjjc\""
Jul 29 06:22:40.741355 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.741054    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 06:22:40.741355 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.741219    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.742154 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.741927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.742442 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.742409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:40.742547 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.742532    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.742609 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.742540    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:40.746126 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.743954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kx6w7\""
Jul 29 06:22:40.747025 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.746999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.748900 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.748802    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:40.748900 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.748865    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:40.749371 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.749350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 06:22:40.749451 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.749433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 06:22:40.749774 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.749739    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 06:22:40.750010 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.749978    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 06:22:40.750092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750069    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 06:22:40.750146 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750117    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 06:22:40.750302 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-system-cni-dir\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.750423 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.750423 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750341    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-systemd\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.750423 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-run\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.750423 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-cnibin\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.750423 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-conf-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnnnz\" (UniqueName: \"kubernetes.io/projected/b9d57cab-d777-4a49-943a-34e48c059812-kube-api-access-tnnnz\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/340af396-d56c-44f3-b05f-0cc471c96b73-multus-daemon-config\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-socket-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-netns\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-registration-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4b79\" (UniqueName: \"kubernetes.io/projected/0a23c30c-26ad-453e-9c10-f858953b66d7-kube-api-access-t4b79\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84996c51-2a76-484c-8fc3-5eff65bab848-serviceca\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f55d408d-4dd9-48ef-a4c4-321ea164bb65-agent-certs\") pod \"konnectivity-agent-rgsdl\" (UID: \"f55d408d-4dd9-48ef-a4c4-321ea164bb65\") " pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-system-cni-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-cnibin\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-etc-kubernetes\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-device-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysctl-conf\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.750670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750678    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8cwk2\""
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.750727    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb6a007a-7076-40ca-9e91-63b8230a6213-hosts-file\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb6a007a-7076-40ca-9e91-63b8230a6213-tmp-dir\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-os-release\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-lib-modules\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-socket-dir-parent\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-multus-certs\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.750978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysconfig\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skcjw\" (UniqueName: \"kubernetes.io/projected/84996c51-2a76-484c-8fc3-5eff65bab848-kube-api-access-skcjw\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-tmp\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-kubelet\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84996c51-2a76-484c-8fc3-5eff65bab848-host\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.751486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98301182-9b79-4109-bd63-c38a3a0ccbb8-host-slash\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/340af396-d56c-44f3-b05f-0cc471c96b73-cni-binary-copy\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-sys-fs\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-kubernetes\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-var-lib-kubelet\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-tuned\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98301182-9b79-4109-bd63-c38a3a0ccbb8-iptables-alerter-script\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-cni-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-cni-multus\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-sys\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751443    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f55d408d-4dd9-48ef-a4c4-321ea164bb65-konnectivity-ca\") pod \"konnectivity-agent-rgsdl\" (UID: \"f55d408d-4dd9-48ef-a4c4-321ea164bb65\") " pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-modprobe-d\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-host\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjh8t\" (UniqueName: \"kubernetes.io/projected/eb6a007a-7076-40ca-9e91-63b8230a6213-kube-api-access-fjh8t\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-hostroot\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.752257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysctl-d\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwglr\" (UniqueName: \"kubernetes.io/projected/98301182-9b79-4109-bd63-c38a3a0ccbb8-kube-api-access-dwglr\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-os-release\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-cni-bin\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-k8s-cni-cncf-io\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfgg\" (UniqueName: \"kubernetes.io/projected/340af396-d56c-44f3-b05f-0cc471c96b73-kube-api-access-kcfgg\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.751639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzt6z\" (UniqueName: \"kubernetes.io/projected/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-kube-api-access-bzt6z\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.753026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.752837    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 06:22:40.765885 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.765864    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g6ptc"
Jul 29 06:22:40.772721 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.772685    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g6ptc"
Jul 29 06:22:40.840023 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.839993    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 06:22:40.852793 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-modprobe-d\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-host\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjh8t\" (UniqueName: \"kubernetes.io/projected/eb6a007a-7076-40ca-9e91-63b8230a6213-kube-api-access-fjh8t\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-hostroot\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-modprobe-d\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-host\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysctl-d\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-hostroot\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.852968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwglr\" (UniqueName: \"kubernetes.io/projected/98301182-9b79-4109-bd63-c38a3a0ccbb8-kube-api-access-dwglr\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-os-release\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.853038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-cni-bin\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-slash\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-os-release\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-k8s-cni-cncf-io\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysctl-d\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfgg\" (UniqueName: \"kubernetes.io/projected/340af396-d56c-44f3-b05f-0cc471c96b73-kube-api-access-kcfgg\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzt6z\" (UniqueName: \"kubernetes.io/projected/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-kube-api-access-bzt6z\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-env-overrides\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qsnf\" (UniqueName: \"kubernetes.io/projected/9951ac15-e995-42ad-9e96-669a8d362e11-kube-api-access-7qsnf\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-system-cni-dir\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-systemd\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-system-cni-dir\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-run\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-run\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-systemd\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.853764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-var-lib-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-cnibin\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-conf-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-systemd\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-cnibin\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-log-socket\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-conf-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnnnz\" (UniqueName: \"kubernetes.io/projected/b9d57cab-d777-4a49-943a-34e48c059812-kube-api-access-tnnnz\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/340af396-d56c-44f3-b05f-0cc471c96b73-multus-daemon-config\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-socket-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-cni-bin\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-netns\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-registration-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-socket-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4b79\" (UniqueName: \"kubernetes.io/projected/0a23c30c-26ad-453e-9c10-f858953b66d7-kube-api-access-t4b79\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.854767 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-netns\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84996c51-2a76-484c-8fc3-5eff65bab848-serviceca\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f55d408d-4dd9-48ef-a4c4-321ea164bb65-agent-certs\") pod \"konnectivity-agent-rgsdl\" (UID: \"f55d408d-4dd9-48ef-a4c4-321ea164bb65\") " pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-registration-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-system-cni-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-cnibin\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-etc-kubernetes\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.853997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-system-cni-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-device-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64ae52ce-78bf-414a-b277-c410b351ac9d-kubelet-config\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-kubelet\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-etc-kubernetes\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysctl-conf\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-cni-bin\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovnkube-config\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-cnibin\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.855463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovnkube-script-lib\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6n9\" (UniqueName: \"kubernetes.io/projected/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-kube-api-access-vp6n9\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-device-dir\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/340af396-d56c-44f3-b05f-0cc471c96b73-multus-daemon-config\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854294    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb6a007a-7076-40ca-9e91-63b8230a6213-hosts-file\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysctl-conf\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb6a007a-7076-40ca-9e91-63b8230a6213-tmp-dir\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84996c51-2a76-484c-8fc3-5eff65bab848-serviceca\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-os-release\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb6a007a-7076-40ca-9e91-63b8230a6213-hosts-file\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-os-release\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-lib-modules\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.856470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-run-ovn-kubernetes\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovn-node-metrics-cert\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-socket-dir-parent\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-multus-certs\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854604    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-lib-modules\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysconfig\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skcjw\" (UniqueName: \"kubernetes.io/projected/84996c51-2a76-484c-8fc3-5eff65bab848-kube-api-access-skcjw\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb6a007a-7076-40ca-9e91-63b8230a6213-tmp-dir\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-sysconfig\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-socket-dir-parent\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-node-log\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.855387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-tmp\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.855390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-k8s-cni-cncf-io\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.855648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.855340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.854797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-run-multus-certs\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9d57cab-d777-4a49-943a-34e48c059812-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.857518 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-kubelet\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84996c51-2a76-484c-8fc3-5eff65bab848-host\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-run-netns\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98301182-9b79-4109-bd63-c38a3a0ccbb8-host-slash\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-kubelet\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84996c51-2a76-484c-8fc3-5eff65bab848-host\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/340af396-d56c-44f3-b05f-0cc471c96b73-cni-binary-copy\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98301182-9b79-4109-bd63-c38a3a0ccbb8-host-slash\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-sys-fs\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-kubernetes\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-var-lib-kubelet\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-tuned\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-systemd-units\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-ovn\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98301182-9b79-4109-bd63-c38a3a0ccbb8-iptables-alerter-script\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-cni-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.858540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-cni-multus\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-sys\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-etc-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/340af396-d56c-44f3-b05f-0cc471c96b73-cni-binary-copy\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-cni-netd\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f55d408d-4dd9-48ef-a4c4-321ea164bb65-konnectivity-ca\") pod \"konnectivity-agent-rgsdl\" (UID: \"f55d408d-4dd9-48ef-a4c4-321ea164bb65\") " pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a23c30c-26ad-453e-9c10-f858953b66d7-sys-fs\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64ae52ce-78bf-414a-b277-c410b351ac9d-dbus\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-kubernetes\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.856902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-var-lib-kubelet\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.857350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-sys\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.857395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98301182-9b79-4109-bd63-c38a3a0ccbb8-iptables-alerter-script\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.857907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f55d408d-4dd9-48ef-a4c4-321ea164bb65-konnectivity-ca\") pod \"konnectivity-agent-rgsdl\" (UID: \"f55d408d-4dd9-48ef-a4c4-321ea164bb65\") " pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.858082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-multus-cni-dir\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.858218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/340af396-d56c-44f3-b05f-0cc471c96b73-host-var-lib-cni-multus\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.858230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f55d408d-4dd9-48ef-a4c4-321ea164bb65-agent-certs\") pod \"konnectivity-agent-rgsdl\" (UID: \"f55d408d-4dd9-48ef-a4c4-321ea164bb65\") " pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.858347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-tmp\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.859468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.858366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9d57cab-d777-4a49-943a-34e48c059812-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.861741 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.861680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-etc-tuned\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.864090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.864065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4b79\" (UniqueName: \"kubernetes.io/projected/0a23c30c-26ad-453e-9c10-f858953b66d7-kube-api-access-t4b79\") pod \"aws-ebs-csi-driver-node-kwmzg\" (UID: \"0a23c30c-26ad-453e-9c10-f858953b66d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:40.864271 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.864252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skcjw\" (UniqueName: \"kubernetes.io/projected/84996c51-2a76-484c-8fc3-5eff65bab848-kube-api-access-skcjw\") pod \"node-ca-cx94n\" (UID: \"84996c51-2a76-484c-8fc3-5eff65bab848\") " pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:40.864560 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.864540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfgg\" (UniqueName: \"kubernetes.io/projected/340af396-d56c-44f3-b05f-0cc471c96b73-kube-api-access-kcfgg\") pod \"multus-6gvdt\" (UID: \"340af396-d56c-44f3-b05f-0cc471c96b73\") " pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:40.864691 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.864668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwglr\" (UniqueName: \"kubernetes.io/projected/98301182-9b79-4109-bd63-c38a3a0ccbb8-kube-api-access-dwglr\") pod \"iptables-alerter-wpk98\" (UID: \"98301182-9b79-4109-bd63-c38a3a0ccbb8\") " pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:40.864756 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.864701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjh8t\" (UniqueName: \"kubernetes.io/projected/eb6a007a-7076-40ca-9e91-63b8230a6213-kube-api-access-fjh8t\") pod \"node-resolver-rtlff\" (UID: \"eb6a007a-7076-40ca-9e91-63b8230a6213\") " pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:40.866145 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.866128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzt6z\" (UniqueName: \"kubernetes.io/projected/4d955c64-c9e0-4671-a9c3-7c3c56ea125a-kube-api-access-bzt6z\") pod \"tuned-xjq8t\" (UID: \"4d955c64-c9e0-4671-a9c3-7c3c56ea125a\") " pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:40.866215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.866189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnnnz\" (UniqueName: \"kubernetes.io/projected/b9d57cab-d777-4a49-943a-34e48c059812-kube-api-access-tnnnz\") pod \"multus-additional-cni-plugins-xwxz7\" (UID: \"b9d57cab-d777-4a49-943a-34e48c059812\") " pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:40.957046 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-run-netns\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-systemd-units\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-ovn\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-etc-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-run-netns\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-systemd-units\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-cni-netd\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-cni-netd\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64ae52ce-78bf-414a-b277-c410b351ac9d-dbus\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-slash\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64ae52ce-78bf-414a-b277-c410b351ac9d-dbus\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-ovn\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-env-overrides\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-slash\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qsnf\" (UniqueName: \"kubernetes.io/projected/9951ac15-e995-42ad-9e96-669a8d362e11-kube-api-access-7qsnf\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.957472    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-var-lib-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-systemd\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-etc-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-systemd\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.957570    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:22:41.457530006 +0000 UTC m=+3.093121775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-var-lib-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.957624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-log-socket\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64ae52ce-78bf-414a-b277-c410b351ac9d-kubelet-config\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-log-socket\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-kubelet\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-kubelet\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64ae52ce-78bf-414a-b277-c410b351ac9d-kubelet-config\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-cni-bin\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-cni-bin\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-run-openvswitch\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovnkube-config\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovnkube-script-lib\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-env-overrides\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6n9\" (UniqueName: \"kubernetes.io/projected/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-kube-api-access-vp6n9\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:40.958402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-run-ovn-kubernetes\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.957985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovn-node-metrics-cert\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.958009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-node-log\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.958035    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.958066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-node-log\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.958101    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:41.458082306 +0000 UTC m=+3.093674093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.958105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-host-run-ovn-kubernetes\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.958268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovnkube-config\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.959090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.958332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovnkube-script-lib\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.960686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.960662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-ovn-node-metrics-cert\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.965842 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.965825    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:22:40.965842 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.965846    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:22:40.965992 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.965855    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:40.965992 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:40.965913    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:41.465901838 +0000 UTC m=+3.101493631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:40.968657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.968636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6n9\" (UniqueName: \"kubernetes.io/projected/e66ffe76-f05d-46ea-a4a9-77aaa6efd621-kube-api-access-vp6n9\") pod \"ovnkube-node-br2sf\" (UID: \"e66ffe76-f05d-46ea-a4a9-77aaa6efd621\") " pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:40.968784 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:40.968762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qsnf\" (UniqueName: \"kubernetes.io/projected/9951ac15-e995-42ad-9e96-669a8d362e11-kube-api-access-7qsnf\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:41.043009 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.042942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rtlff"
Jul 29 06:22:41.053813 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.053788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wpk98"
Jul 29 06:22:41.062337 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.062316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cx94n"
Jul 29 06:22:41.077032 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.077008    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6gvdt"
Jul 29 06:22:41.085670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.085642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwxz7"
Jul 29 06:22:41.093258 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.093238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:22:41.100888 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.100854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg"
Jul 29 06:22:41.106263 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.106245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjq8t"
Jul 29 06:22:41.110844 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.110828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:22:41.460322 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.460234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:41.460322 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.460301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:41.460536 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.460405    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:41.460536 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.460416    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:41.460536 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.460475    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:22:42.460457192 +0000 UTC m=+4.096048985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:41.460536 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.460493    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:42.460485768 +0000 UTC m=+4.096077539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:41.561143 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.561100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:41.561296 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.561257    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:22:41.561296 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.561277    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:22:41.561296 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.561287    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:41.561429 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.561346    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:42.561327248 +0000 UTC m=+4.196919016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:41.696511 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.696486    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d955c64_c9e0_4671_a9c3_7c3c56ea125a.slice/crio-2f430d714fa814f34dfee6fe750caa47ba8ff323d19d29b8014626e287cef56d WatchSource:0}: Error finding container 2f430d714fa814f34dfee6fe750caa47ba8ff323d19d29b8014626e287cef56d: Status 404 returned error can't find the container with id 2f430d714fa814f34dfee6fe750caa47ba8ff323d19d29b8014626e287cef56d
Jul 29 06:22:41.698311 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.698267    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a23c30c_26ad_453e_9c10_f858953b66d7.slice/crio-b545e09bef34db7f8dc55884de8811a2916264f40c70dd09a9d1f8cf0ccefac9 WatchSource:0}: Error finding container b545e09bef34db7f8dc55884de8811a2916264f40c70dd09a9d1f8cf0ccefac9: Status 404 returned error can't find the container with id b545e09bef34db7f8dc55884de8811a2916264f40c70dd09a9d1f8cf0ccefac9
Jul 29 06:22:41.700826 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.700802    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d57cab_d777_4a49_943a_34e48c059812.slice/crio-c259d5bbee724ff3af8336dd1a6184679b53db17e8c3d6066a89803bac80ee7e WatchSource:0}: Error finding container c259d5bbee724ff3af8336dd1a6184679b53db17e8c3d6066a89803bac80ee7e: Status 404 returned error can't find the container with id c259d5bbee724ff3af8336dd1a6184679b53db17e8c3d6066a89803bac80ee7e
Jul 29 06:22:41.701636 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.701606    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340af396_d56c_44f3_b05f_0cc471c96b73.slice/crio-3d950168d88c39506f7d5e4113363980dda2a038e84f74e5a303fdd7646862fc WatchSource:0}: Error finding container 3d950168d88c39506f7d5e4113363980dda2a038e84f74e5a303fdd7646862fc: Status 404 returned error can't find the container with id 3d950168d88c39506f7d5e4113363980dda2a038e84f74e5a303fdd7646862fc
Jul 29 06:22:41.702439 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.702412    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66ffe76_f05d_46ea_a4a9_77aaa6efd621.slice/crio-b587536274d6069947eff66a1b1393fed8891b2030e79cd0d39a2635d051e4fa WatchSource:0}: Error finding container b587536274d6069947eff66a1b1393fed8891b2030e79cd0d39a2635d051e4fa: Status 404 returned error can't find the container with id b587536274d6069947eff66a1b1393fed8891b2030e79cd0d39a2635d051e4fa
Jul 29 06:22:41.705664 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.705068    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55d408d_4dd9_48ef_a4c4_321ea164bb65.slice/crio-ea60ed28a2eee55e784305bfdfa3031753318247f2db0d280fab459c4aaa783a WatchSource:0}: Error finding container ea60ed28a2eee55e784305bfdfa3031753318247f2db0d280fab459c4aaa783a: Status 404 returned error can't find the container with id ea60ed28a2eee55e784305bfdfa3031753318247f2db0d280fab459c4aaa783a
Jul 29 06:22:41.707227 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.707201    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6a007a_7076_40ca_9e91_63b8230a6213.slice/crio-44822ce48c98c0db05a1ce383875d77098de5bee7e3c9768d91a3d92310743f3 WatchSource:0}: Error finding container 44822ce48c98c0db05a1ce383875d77098de5bee7e3c9768d91a3d92310743f3: Status 404 returned error can't find the container with id 44822ce48c98c0db05a1ce383875d77098de5bee7e3c9768d91a3d92310743f3
Jul 29 06:22:41.707969 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:22:41.707527    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98301182_9b79_4109_bd63_c38a3a0ccbb8.slice/crio-8743270c0ca33af86dd4515fa21b885b4305094045ff7760fc9fbb403958117c WatchSource:0}: Error finding container 8743270c0ca33af86dd4515fa21b885b4305094045ff7760fc9fbb403958117c: Status 404 returned error can't find the container with id 8743270c0ca33af86dd4515fa21b885b4305094045ff7760fc9fbb403958117c
Jul 29 06:22:41.775580 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.775323    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 06:17:40 +0000 UTC" deadline="2028-04-09 03:48:16.462655358 +0000 UTC"
Jul 29 06:22:41.775580 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.775529    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14877h25m34.687135455s"
Jul 29 06:22:41.898916 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.898889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:41.899051 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:41.899027    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:41.905995 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.905957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rtlff" event={"ID":"eb6a007a-7076-40ca-9e91-63b8230a6213","Type":"ContainerStarted","Data":"44822ce48c98c0db05a1ce383875d77098de5bee7e3c9768d91a3d92310743f3"}
Jul 29 06:22:41.907256 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.907231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rgsdl" event={"ID":"f55d408d-4dd9-48ef-a4c4-321ea164bb65","Type":"ContainerStarted","Data":"ea60ed28a2eee55e784305bfdfa3031753318247f2db0d280fab459c4aaa783a"}
Jul 29 06:22:41.908284 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.908264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"b587536274d6069947eff66a1b1393fed8891b2030e79cd0d39a2635d051e4fa"}
Jul 29 06:22:41.909296 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.909277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerStarted","Data":"c259d5bbee724ff3af8336dd1a6184679b53db17e8c3d6066a89803bac80ee7e"}
Jul 29 06:22:41.910397 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.910370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wpk98" event={"ID":"98301182-9b79-4109-bd63-c38a3a0ccbb8","Type":"ContainerStarted","Data":"8743270c0ca33af86dd4515fa21b885b4305094045ff7760fc9fbb403958117c"}
Jul 29 06:22:41.911336 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.911311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cx94n" event={"ID":"84996c51-2a76-484c-8fc3-5eff65bab848","Type":"ContainerStarted","Data":"10a5fffb7e6b361a782d4c146a3b7e62f11c132e1d7207077c8833e8aca23167"}
Jul 29 06:22:41.912381 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.912361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6gvdt" event={"ID":"340af396-d56c-44f3-b05f-0cc471c96b73","Type":"ContainerStarted","Data":"3d950168d88c39506f7d5e4113363980dda2a038e84f74e5a303fdd7646862fc"}
Jul 29 06:22:41.913431 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.913407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg" event={"ID":"0a23c30c-26ad-453e-9c10-f858953b66d7","Type":"ContainerStarted","Data":"b545e09bef34db7f8dc55884de8811a2916264f40c70dd09a9d1f8cf0ccefac9"}
Jul 29 06:22:41.914310 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.914283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjq8t" event={"ID":"4d955c64-c9e0-4671-a9c3-7c3c56ea125a","Type":"ContainerStarted","Data":"2f430d714fa814f34dfee6fe750caa47ba8ff323d19d29b8014626e287cef56d"}
Jul 29 06:22:41.916071 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.916052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" event={"ID":"549091cca5f0a3b021a686609b790c31","Type":"ContainerStarted","Data":"1dff127ef0cf98b283be258e46e2453b463d4d7cf2d3ab886d528d8f4f9236fc"}
Jul 29 06:22:41.929258 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:41.929217    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" podStartSLOduration=2.929205761 podStartE2EDuration="2.929205761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:22:41.928743277 +0000 UTC m=+3.564335064" watchObservedRunningTime="2026-07-29 06:22:41.929205761 +0000 UTC m=+3.564797553"
Jul 29 06:22:42.470778 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.470744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:42.470929 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.470913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:42.471158 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.471056    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:42.471238 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.471216    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:44.47119523 +0000 UTC m=+6.106787002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:42.471854 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.471693    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:42.471854 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.471832    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:22:44.47181458 +0000 UTC m=+6.107406354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:42.572265 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.572222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:42.572448 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.572429    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:22:42.572520 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.572456    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:22:42.572520 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.572468    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:42.572618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.572526    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:44.572507666 +0000 UTC m=+6.208099454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:42.775933 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.775821    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 06:17:40 +0000 UTC" deadline="2028-02-06 19:47:04.31054688 +0000 UTC"
Jul 29 06:22:42.775933 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.775882    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13381h24m21.534668467s"
Jul 29 06:22:42.901200 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.900683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:42.901200 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.900841    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:42.901200 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.900887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:42.901200 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:42.900991    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:42.935034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.934998    2578 generic.go:356] "Generic (PLEG): container finished" podID="b41261809a518fbe94d34f36a76ff2a6" containerID="8a7692b6eb272b840bb279df3740cb02d54c47fa6800fcf4a1c9134c0595f1fb" exitCode=0
Jul 29 06:22:42.935795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:42.935767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" event={"ID":"b41261809a518fbe94d34f36a76ff2a6","Type":"ContainerDied","Data":"8a7692b6eb272b840bb279df3740cb02d54c47fa6800fcf4a1c9134c0595f1fb"}
Jul 29 06:22:43.899138 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:43.899105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:43.899604 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:43.899243    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:43.954513 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:43.954458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" event={"ID":"b41261809a518fbe94d34f36a76ff2a6","Type":"ContainerStarted","Data":"f27f9b5cc78e1755903885d94089ef3921b82969a06504b4211e52fcbc45f5e6"}
Jul 29 06:22:44.487490 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:44.486689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:44.487490 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:44.486778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:44.487490 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.486939    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:44.487490 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.487003    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:22:48.486985055 +0000 UTC m=+10.122576832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:44.487490 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.487376    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:44.487490 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.487419    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:48.487404634 +0000 UTC m=+10.122996405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:44.587566 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:44.587442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:44.587786 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.587633    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:22:44.587786 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.587700    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:22:44.587786 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.587742    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:44.587956 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.587802    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:48.587781512 +0000 UTC m=+10.223373296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:44.902143 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:44.899661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:44.902143 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.899825    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:44.902143 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:44.900224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:44.902143 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:44.900311    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:45.898864 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:45.898525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:45.898864 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:45.898651    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:46.898785 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:46.898111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:46.898785 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:46.898258    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:46.898785 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:46.898639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:46.898785 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:46.898743    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:47.899096 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:47.899063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:47.899463 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:47.899181    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:48.521937 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:48.521902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:48.522131 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:48.521985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:48.522131 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.522107    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:48.522216 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.522160    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:56.522147141 +0000 UTC m=+18.157738909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:48.522510 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.522494    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:48.522586 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.522543    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:22:56.522531367 +0000 UTC m=+18.158123137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:48.622948 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:48.622909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:48.623171 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.623154    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:22:48.623250 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.623176    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:22:48.623250 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.623185    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:48.623250 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.623229    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:22:56.623216129 +0000 UTC m=+18.258807897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:48.902160 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:48.901649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:48.902160 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:48.901796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:48.902160 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.901903    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:48.902160 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:48.901791    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:49.898875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:49.898842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:49.899033 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:49.898997    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:50.899087 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:50.899048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:50.899569 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:50.899110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:50.899569 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:50.899230    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:50.899841 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:50.899817    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:51.898881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:51.898844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:51.899025 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:51.898956    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:52.899032 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:52.898996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:52.899492 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:52.899129    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:52.899492 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:52.899195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:52.899492 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:52.899311    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:53.898467 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:53.898433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:53.898629 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:53.898537    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:54.898434 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:54.898385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:54.898861 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:54.898538    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:54.898861 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:54.898572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:54.898861 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:54.898698    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:55.898892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:55.898857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:55.899328 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:55.898992    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:56.583412 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:56.583369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:56.583564 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:56.583462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:56.583564 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.583536    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:56.583564 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.583553    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:56.583729 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.583606    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:23:12.583586748 +0000 UTC m=+34.219178516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:22:56.583729 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.583624    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:12.583615155 +0000 UTC m=+34.219206929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:22:56.684227 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:56.684184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:56.684452 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.684335    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:22:56.684452 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.684355    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:22:56.684452 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.684366    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:56.684452 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.684428    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:23:12.68441417 +0000 UTC m=+34.320005953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:22:56.898793 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:56.898689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:56.898946 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.898845    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:56.898946 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:56.898910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:56.899360 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:56.899038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:57.898454 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:57.898416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:57.898651 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:57.898543    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:22:58.899608 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:58.899568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:22:58.900092 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:58.899692    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:22:58.900092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:58.900084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:22:58.900214 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:58.900193    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:22:59.898722 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:22:59.898681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:22:59.898857 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:22:59.898796    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:00.899406 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.899200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:00.900312 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.899265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:00.900312 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:00.899571    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:00.900312 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:00.899702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:00.990642 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.990604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rtlff" event={"ID":"eb6a007a-7076-40ca-9e91-63b8230a6213","Type":"ContainerStarted","Data":"e0bbc87bd8af51b7e2cfe70e4784a0e56e85f2a9924e8ae568f0d8b1c9b5f523"}
Jul 29 06:23:00.992395 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.992370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rgsdl" event={"ID":"f55d408d-4dd9-48ef-a4c4-321ea164bb65","Type":"ContainerStarted","Data":"1b994e0d12ed13162e51dea0acb5c61e0ef8b038633efd48d8511839544a2587"}
Jul 29 06:23:00.995788 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.995767    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:23:00.996209 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996181    2578 generic.go:356] "Generic (PLEG): container finished" podID="e66ffe76-f05d-46ea-a4a9-77aaa6efd621" containerID="2ab2e2a72b607104d82a7fef71d16da9612c1f8bddccf1d8d9238712fe0c915c" exitCode=1
Jul 29 06:23:00.996309 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"5e5b2ba7c5e58cc6c72dbf28eab72a48f5469d2c7b2005db0833f1f51a45d05f"}
Jul 29 06:23:00.996369 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"36b697fbe15f8f65528d3364f2309bc2ff30aa03d0e477836b93d97320c8a9f9"}
Jul 29 06:23:00.996433 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"2416e2cfb7671cd7fbc6b431b5bbbe54994b49fae595cc4f0d7f98b3d8cc2379"}
Jul 29 06:23:00.996488 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"ce291d7dcfe5ed64f3ea2f3c07578f79972d5feef0c3c9530841fc9f90689405"}
Jul 29 06:23:00.996488 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerDied","Data":"2ab2e2a72b607104d82a7fef71d16da9612c1f8bddccf1d8d9238712fe0c915c"}
Jul 29 06:23:00.996585 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.996531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"fcbac3cfcaa9a917029010255a1116118cfbfcab76139d1eb9d57e82ffac4d10"}
Jul 29 06:23:00.997982 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.997956    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9d57cab-d777-4a49-943a-34e48c059812" containerID="1d43772fc65542ee07a17288c3f1d2d06f8c93b6549882126b4ed251d1ad30d1" exitCode=0
Jul 29 06:23:00.998083 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.997984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerDied","Data":"1d43772fc65542ee07a17288c3f1d2d06f8c93b6549882126b4ed251d1ad30d1"}
Jul 29 06:23:00.999722 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:00.999678    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cx94n" event={"ID":"84996c51-2a76-484c-8fc3-5eff65bab848","Type":"ContainerStarted","Data":"d29d52ccbbcdf8b752c7875c08c6677711cb8de6749e20cc943951af0bef844e"}
Jul 29 06:23:01.001546 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.001522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6gvdt" event={"ID":"340af396-d56c-44f3-b05f-0cc471c96b73","Type":"ContainerStarted","Data":"1b1d6e186d45102516c18108ebf4a9faa44f0d27617a6475c0d923e4174b7028"}
Jul 29 06:23:01.004211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.004175    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" podStartSLOduration=22.004162744 podStartE2EDuration="22.004162744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:22:43.969423189 +0000 UTC m=+5.605014982" watchObservedRunningTime="2026-07-29 06:23:01.004162744 +0000 UTC m=+22.639754535"
Jul 29 06:23:01.005313 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.005274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg" event={"ID":"0a23c30c-26ad-453e-9c10-f858953b66d7","Type":"ContainerStarted","Data":"857bd2f8a4fe548f0ace1bb3a8e82d7be68d2eec4ffe7a66421d5296fc3ada87"}
Jul 29 06:23:01.006661 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.006641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjq8t" event={"ID":"4d955c64-c9e0-4671-a9c3-7c3c56ea125a","Type":"ContainerStarted","Data":"a7aa85a882817a767b7a223acb4eb2d15ee01825f0121b42dd8a84b7d17e6eeb"}
Jul 29 06:23:01.019418 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.019383    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rtlff" podStartSLOduration=4.730866886 podStartE2EDuration="23.019370755s" totalImagesPullingTime="18.288503869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:01.004816798 +0000 UTC m=+22.640408592" watchObservedRunningTime="2026-07-29 06:23:01.019370755 +0000 UTC m=+22.654962552"
Jul 29 06:23:01.019698 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.019673    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cx94n" podStartSLOduration=4.726803022 podStartE2EDuration="23.019665796s" totalImagesPullingTime="18.292862774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:01.019461351 +0000 UTC m=+22.655053132" watchObservedRunningTime="2026-07-29 06:23:01.019665796 +0000 UTC m=+22.655257586"
Jul 29 06:23:01.062804 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.062735    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6gvdt" podStartSLOduration=4.720725028 podStartE2EDuration="23.062697785s" totalImagesPullingTime="18.341972757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:01.06237815 +0000 UTC m=+22.697969962" watchObservedRunningTime="2026-07-29 06:23:01.062697785 +0000 UTC m=+22.698289573"
Jul 29 06:23:01.078068 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.078031    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rgsdl" podStartSLOduration=12.854498742 podStartE2EDuration="23.078017358s" totalImagesPullingTime="10.223518616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:01.077679045 +0000 UTC m=+22.713270836" watchObservedRunningTime="2026-07-29 06:23:01.078017358 +0000 UTC m=+22.713609150"
Jul 29 06:23:01.093286 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.093238    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xjq8t" podStartSLOduration=4.789876013 podStartE2EDuration="23.093225934s" totalImagesPullingTime="18.303349921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:01.092827621 +0000 UTC m=+22.728419412" watchObservedRunningTime="2026-07-29 06:23:01.093225934 +0000 UTC m=+22.728817725"
Jul 29 06:23:01.287559 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.287537    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 06:23:01.816157 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.816007    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T06:23:01.287555591Z","UUID":"2d9a6083-b256-47c6-9b8a-7f9f3ef2aeba","Handler":null,"Name":"","Endpoint":""}
Jul 29 06:23:01.818050 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.818027    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 06:23:01.818173 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.818076    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 06:23:01.898855 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:01.898823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:01.899036 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:01.898949    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:02.010745 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:02.010685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wpk98" event={"ID":"98301182-9b79-4109-bd63-c38a3a0ccbb8","Type":"ContainerStarted","Data":"5b18efe742b534cb43cde891b78075ad14e6db6607143007730fa8f837fdefa9"}
Jul 29 06:23:02.015669 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:02.013812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg" event={"ID":"0a23c30c-26ad-453e-9c10-f858953b66d7","Type":"ContainerStarted","Data":"0694b21ccb8a897b73421095d1b4179353e664d42af14ac6a99dd2cf3b52774c"}
Jul 29 06:23:02.025983 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:02.025930    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wpk98" podStartSLOduration=5.736616874 podStartE2EDuration="24.025910906s" totalImagesPullingTime="18.289294032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:02.025741793 +0000 UTC m=+23.661333596" watchObservedRunningTime="2026-07-29 06:23:02.025910906 +0000 UTC m=+23.661502699"
Jul 29 06:23:02.898484 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:02.898434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:02.898643 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:02.898593    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:02.898723 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:02.898649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:02.898808 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:02.898777    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:03.020177 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:03.020137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg" event={"ID":"0a23c30c-26ad-453e-9c10-f858953b66d7","Type":"ContainerStarted","Data":"85a58f15c9ec5218f097ac0258f567189efb68476e4818d09040208e16947be3"}
Jul 29 06:23:03.024598 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:03.024567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:23:03.024968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:03.024940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"6300d74e28bad8e1095af264fde0b83ce0f09a1fa05ce74f41a5e266297d37b5"}
Jul 29 06:23:03.038704 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:03.038653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwmzg" podStartSLOduration=4.827692345 podStartE2EDuration="25.038638055s" totalImagesPullingTime="20.21094571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:03.037544637 +0000 UTC m=+24.673136458" watchObservedRunningTime="2026-07-29 06:23:03.038638055 +0000 UTC m=+24.674229845"
Jul 29 06:23:03.899068 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:03.898896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:03.899254 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:03.899145    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:04.119968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:04.119926    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:23:04.120686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:04.120663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:23:04.899087 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:04.899052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:04.899253 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:04.899194    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:04.899304 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:04.899247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:04.899366 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:04.899339    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:05.029091 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:05.029067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:23:05.029651 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:05.029625    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rgsdl"
Jul 29 06:23:05.898816 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:05.898589    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:05.899471 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:05.898891    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:06.034555 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.034526    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:23:06.034967 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.034942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"4e800e4227f8c7cc3de3e9a7fab743f703c8846a0beb84de6a4501039efc9f8e"}
Jul 29 06:23:06.035329 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.035277    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:23:06.035434 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.035389    2578 scope.go:117] "RemoveContainer" containerID="2ab2e2a72b607104d82a7fef71d16da9612c1f8bddccf1d8d9238712fe0c915c"
Jul 29 06:23:06.036801 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.036772    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9d57cab-d777-4a49-943a-34e48c059812" containerID="71ffbf3e94e35e78fd6125567642e74419d64fef3538a865e2ac3798b51cb3ac" exitCode=0
Jul 29 06:23:06.036903 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.036852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerDied","Data":"71ffbf3e94e35e78fd6125567642e74419d64fef3538a865e2ac3798b51cb3ac"}
Jul 29 06:23:06.054593 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.054569    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:23:06.898494 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.898456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:06.898603 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:06.898585    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:06.898645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:06.898629    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:06.898762 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:06.898745    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:07.042555 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.042487    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:23:07.043006 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.042870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" event={"ID":"e66ffe76-f05d-46ea-a4a9-77aaa6efd621","Type":"ContainerStarted","Data":"b231815050e235841dd8182d2587277282c1364c42b2d91f6d1e5d3062c2d755"}
Jul 29 06:23:07.043075 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.043027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:23:07.043126 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.043100    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:23:07.045113 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.045088    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9d57cab-d777-4a49-943a-34e48c059812" containerID="3696f4341501f6ad39491786cf9ae8932d3aaa6f0c1ca9ca66f50ce40f924fc6" exitCode=0
Jul 29 06:23:07.045215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.045132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerDied","Data":"3696f4341501f6ad39491786cf9ae8932d3aaa6f0c1ca9ca66f50ce40f924fc6"}
Jul 29 06:23:07.059607 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.059581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:23:07.069537 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.069490    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf" podStartSLOduration=9.75105438 podStartE2EDuration="28.069478322s" totalImagesPullingTime="18.318423942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:07.068324783 +0000 UTC m=+28.703916577" watchObservedRunningTime="2026-07-29 06:23:07.069478322 +0000 UTC m=+28.705070161"
Jul 29 06:23:07.073803 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.073774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvlsn"]
Jul 29 06:23:07.073922 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.073908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:07.074005 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:07.073989    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:07.077211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.077190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h4557"]
Jul 29 06:23:07.077325 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.077297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:07.077466 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:07.077444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:07.077827 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.077799    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m7dhw"]
Jul 29 06:23:07.077905 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:07.077894    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:07.077985 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:07.077964    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:08.049509 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:08.049248    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9d57cab-d777-4a49-943a-34e48c059812" containerID="a10aa1fd5207ced4e28fb75c5821ffa3432faccc9652b7ddde72127762c3ecb4" exitCode=0
Jul 29 06:23:08.049509 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:08.049325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerDied","Data":"a10aa1fd5207ced4e28fb75c5821ffa3432faccc9652b7ddde72127762c3ecb4"}
Jul 29 06:23:08.899726 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:08.899684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:08.899933 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:08.899893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:08.899933 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:08.899888    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:08.899933 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:08.899915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:08.900105 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:08.899993    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:08.900159 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:08.900120    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:10.899110 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:10.899075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:10.899110 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:10.899103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:10.899736 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:10.899077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:10.899736 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:10.899185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:10.899736 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:10.899255    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:10.899736 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:10.899343    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:12.598280 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:12.598249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:12.598759 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:12.598299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:12.598759 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.598396    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 06:23:12.598759 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.598396    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:23:12.598759 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.598444    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret podName:64ae52ce-78bf-414a-b277-c410b351ac9d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:44.598431871 +0000 UTC m=+66.234023643 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret") pod "global-pull-secret-syncer-m7dhw" (UID: "64ae52ce-78bf-414a-b277-c410b351ac9d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 06:23:12.598759 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.598458    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:23:44.598451398 +0000 UTC m=+66.234043166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 06:23:12.699361 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:12.699334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:12.699544 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.699451    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 06:23:12.699544 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.699464    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 06:23:12.699544 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.699473    2578 projected.go:196] Error preparing data for projected volume kube-api-access-97s4q for pod openshift-network-diagnostics/network-check-target-gvlsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:23:12.699544 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.699522    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q podName:b4debcc9-5283-404d-9a73-1e31c69ae933 nodeName:}" failed. No retries permitted until 2026-07-29 06:23:44.699509552 +0000 UTC m=+66.335101335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-97s4q" (UniqueName: "kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q") pod "network-check-target-gvlsn" (UID: "b4debcc9-5283-404d-9a73-1e31c69ae933") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 06:23:12.898551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:12.898523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:12.898551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:12.898555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:12.898779 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:12.898523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:12.898779 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.898644    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:23:12.898779 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.898698    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m7dhw" podUID="64ae52ce-78bf-414a-b277-c410b351ac9d"
Jul 29 06:23:12.898879 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:12.898782    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvlsn" podUID="b4debcc9-5283-404d-9a73-1e31c69ae933"
Jul 29 06:23:13.064390 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.064353    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9d57cab-d777-4a49-943a-34e48c059812" containerID="742c1b1dd50bec4d1f82af55add57d2fd602e855687f7685200cb6a155efd55c" exitCode=0
Jul 29 06:23:13.064390 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.064392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerDied","Data":"742c1b1dd50bec4d1f82af55add57d2fd602e855687f7685200cb6a155efd55c"}
Jul 29 06:23:13.196296 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.196256    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeReady"
Jul 29 06:23:13.196785 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.196405    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 06:23:13.235148 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.235121    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5rxmn"]
Jul 29 06:23:13.257126 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.257099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m9nk9"]
Jul 29 06:23:13.257244 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.257219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.259499 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.259480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 06:23:13.259634 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.259502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 06:23:13.259634 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.259514    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z5482\""
Jul 29 06:23:13.279172 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.279147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rxmn"]
Jul 29 06:23:13.279290 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.279181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m9nk9"]
Jul 29 06:23:13.279290 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.279261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.281625 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.281595    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 06:23:13.281625 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.281597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pmx92\""
Jul 29 06:23:13.281919 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.281905    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 06:23:13.281992 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.281957    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 06:23:13.403291 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.403258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85cfbced-8f75-4d1a-b9eb-601c8b10140d-config-volume\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.403440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.403297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdcd\" (UniqueName: \"kubernetes.io/projected/85cfbced-8f75-4d1a-b9eb-601c8b10140d-kube-api-access-6gdcd\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.403440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.403335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44d59680-97e5-4bb5-afbb-e8f05a4806fa-cert\") pod \"ingress-canary-m9nk9\" (UID: \"44d59680-97e5-4bb5-afbb-e8f05a4806fa\") " pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.403440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.403352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.403440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.403411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85cfbced-8f75-4d1a-b9eb-601c8b10140d-tmp-dir\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.403440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.403434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjc48\" (UniqueName: \"kubernetes.io/projected/44d59680-97e5-4bb5-afbb-e8f05a4806fa-kube-api-access-fjc48\") pod \"ingress-canary-m9nk9\" (UID: \"44d59680-97e5-4bb5-afbb-e8f05a4806fa\") " pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.504641 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.504564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44d59680-97e5-4bb5-afbb-e8f05a4806fa-cert\") pod \"ingress-canary-m9nk9\" (UID: \"44d59680-97e5-4bb5-afbb-e8f05a4806fa\") " pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.504641 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.504599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.504822 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:13.504732    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:13.504822 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.504742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85cfbced-8f75-4d1a-b9eb-601c8b10140d-tmp-dir\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.504822 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:13.504782    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:14.004768419 +0000 UTC m=+35.640360187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:13.504822 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.504812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjc48\" (UniqueName: \"kubernetes.io/projected/44d59680-97e5-4bb5-afbb-e8f05a4806fa-kube-api-access-fjc48\") pod \"ingress-canary-m9nk9\" (UID: \"44d59680-97e5-4bb5-afbb-e8f05a4806fa\") " pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.505005 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.504862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85cfbced-8f75-4d1a-b9eb-601c8b10140d-config-volume\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.505005 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.504883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdcd\" (UniqueName: \"kubernetes.io/projected/85cfbced-8f75-4d1a-b9eb-601c8b10140d-kube-api-access-6gdcd\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.505089 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.505072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85cfbced-8f75-4d1a-b9eb-601c8b10140d-tmp-dir\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.505456 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.505440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85cfbced-8f75-4d1a-b9eb-601c8b10140d-config-volume\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.509368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.509187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44d59680-97e5-4bb5-afbb-e8f05a4806fa-cert\") pod \"ingress-canary-m9nk9\" (UID: \"44d59680-97e5-4bb5-afbb-e8f05a4806fa\") " pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.514771 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.514750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjc48\" (UniqueName: \"kubernetes.io/projected/44d59680-97e5-4bb5-afbb-e8f05a4806fa-kube-api-access-fjc48\") pod \"ingress-canary-m9nk9\" (UID: \"44d59680-97e5-4bb5-afbb-e8f05a4806fa\") " pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.518719 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.518691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdcd\" (UniqueName: \"kubernetes.io/projected/85cfbced-8f75-4d1a-b9eb-601c8b10140d-kube-api-access-6gdcd\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:13.593594 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.593560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m9nk9"
Jul 29 06:23:13.750137 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:13.750086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m9nk9"]
Jul 29 06:23:13.754370 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:23:13.754342    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d59680_97e5_4bb5_afbb_e8f05a4806fa.slice/crio-ddb2d15b5026935e6d71d284ac1f0b419095f359cd4a742d41077d4624adf63d WatchSource:0}: Error finding container ddb2d15b5026935e6d71d284ac1f0b419095f359cd4a742d41077d4624adf63d: Status 404 returned error can't find the container with id ddb2d15b5026935e6d71d284ac1f0b419095f359cd4a742d41077d4624adf63d
Jul 29 06:23:14.010257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.010175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:14.010479 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:14.010300    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:14.010479 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:14.010360    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:15.010347592 +0000 UTC m=+36.645939360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:14.071285 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.071245    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9d57cab-d777-4a49-943a-34e48c059812" containerID="8fe7a1ac1f171945e91648f86249019a2dd9cc1e9e2c529c9e9885a6127da9f5" exitCode=0
Jul 29 06:23:14.071460 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.071331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerDied","Data":"8fe7a1ac1f171945e91648f86249019a2dd9cc1e9e2c529c9e9885a6127da9f5"}
Jul 29 06:23:14.072474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.072446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m9nk9" event={"ID":"44d59680-97e5-4bb5-afbb-e8f05a4806fa","Type":"ContainerStarted","Data":"ddb2d15b5026935e6d71d284ac1f0b419095f359cd4a742d41077d4624adf63d"}
Jul 29 06:23:14.898754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.898702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:14.899316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.898762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:14.899316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.898701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:14.903441 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.903417    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-btmpr\""
Jul 29 06:23:14.903613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.903450    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4kn4r\""
Jul 29 06:23:14.903613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.903453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 06:23:14.903613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.903545    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 06:23:14.903792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.903450    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 06:23:14.903792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:14.903645    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 06:23:15.017914 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:15.017875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:15.018094 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:15.018020    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:15.018148 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:15.018106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:17.018082683 +0000 UTC m=+38.653674455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:15.077811 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:15.077780    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" event={"ID":"b9d57cab-d777-4a49-943a-34e48c059812","Type":"ContainerStarted","Data":"9de79d374d3284cd817a65fca555bff609833aeff2c9b49bac62b0cf7c29c7f1"}
Jul 29 06:23:15.097171 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:15.097126    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xwxz7" podStartSLOduration=8.995513339 podStartE2EDuration="37.097113152s" totalImagesPullingTime="28.101599813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:15.095973687 +0000 UTC m=+36.731565479" watchObservedRunningTime="2026-07-29 06:23:15.097113152 +0000 UTC m=+36.732704942"
Jul 29 06:23:16.081623 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:16.081446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m9nk9" event={"ID":"44d59680-97e5-4bb5-afbb-e8f05a4806fa","Type":"ContainerStarted","Data":"d4c05a1bc815ab8ffbc0fdffe41785bc869bf05c53693e18c564dfdcb1828c62"}
Jul 29 06:23:16.097973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:16.097928    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m9nk9" podStartSLOduration=0.895572657 podStartE2EDuration="3.0979106s" totalImagesPullingTime="2.202337943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:16.096593885 +0000 UTC m=+37.732185676" watchObservedRunningTime="2026-07-29 06:23:16.0979106 +0000 UTC m=+37.733502390"
Jul 29 06:23:17.032106 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:17.032070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:17.032263 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:17.032177    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:17.032263 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:17.032228    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:21.032215329 +0000 UTC m=+42.667807097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:21.059125 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:21.059087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:21.059884 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:21.059265    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:21.059884 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:21.059343    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:29.059323086 +0000 UTC m=+50.694914869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:29.116121 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:29.116083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:29.116504 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:29.116226    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:29.116504 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:29.116291    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:23:45.116270543 +0000 UTC m=+66.751862333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:39.063577 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:39.063542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-br2sf"
Jul 29 06:23:44.628992 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.628945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:23:44.629441 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.629012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:44.631581 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.631558    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 06:23:44.631650 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.631632    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 06:23:44.639764 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:44.639736    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 06:23:44.639840 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:44.639822    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:24:48.639803352 +0000 UTC m=+130.275395123 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : secret "metrics-daemon-secret" not found
Jul 29 06:23:44.643512 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.643485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64ae52ce-78bf-414a-b277-c410b351ac9d-original-pull-secret\") pod \"global-pull-secret-syncer-m7dhw\" (UID: \"64ae52ce-78bf-414a-b277-c410b351ac9d\") " pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:44.730019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.729980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:44.733067 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.733049    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 06:23:44.742606 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.742585    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 06:23:44.753179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.753152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97s4q\" (UniqueName: \"kubernetes.io/projected/b4debcc9-5283-404d-9a73-1e31c69ae933-kube-api-access-97s4q\") pod \"network-check-target-gvlsn\" (UID: \"b4debcc9-5283-404d-9a73-1e31c69ae933\") " pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:44.914676 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.914598    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4kn4r\""
Jul 29 06:23:44.922865 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.922837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:44.925146 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:44.925128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m7dhw"
Jul 29 06:23:45.082900 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:45.082867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvlsn"]
Jul 29 06:23:45.086816 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:23:45.086787    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4debcc9_5283_404d_9a73_1e31c69ae933.slice/crio-700fe306727008107363f68d9dce81d2aa5ef243f604e695eb5f07cedcc0518b WatchSource:0}: Error finding container 700fe306727008107363f68d9dce81d2aa5ef243f604e695eb5f07cedcc0518b: Status 404 returned error can't find the container with id 700fe306727008107363f68d9dce81d2aa5ef243f604e695eb5f07cedcc0518b
Jul 29 06:23:45.100701 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:45.100678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m7dhw"]
Jul 29 06:23:45.103865 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:23:45.103832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ae52ce_78bf_414a_b277_c410b351ac9d.slice/crio-c894cce1d7c929e6670f5d24b758478dc2d2216e4388b800ab6f8300cdf856ce WatchSource:0}: Error finding container c894cce1d7c929e6670f5d24b758478dc2d2216e4388b800ab6f8300cdf856ce: Status 404 returned error can't find the container with id c894cce1d7c929e6670f5d24b758478dc2d2216e4388b800ab6f8300cdf856ce
Jul 29 06:23:45.132997 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:45.132961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:23:45.133158 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:45.133120    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:23:45.133220 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:23:45.133208    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:24:17.133188275 +0000 UTC m=+98.768780045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:23:45.151757 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:45.151723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m7dhw" event={"ID":"64ae52ce-78bf-414a-b277-c410b351ac9d","Type":"ContainerStarted","Data":"c894cce1d7c929e6670f5d24b758478dc2d2216e4388b800ab6f8300cdf856ce"}
Jul 29 06:23:45.152795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:45.152773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvlsn" event={"ID":"b4debcc9-5283-404d-9a73-1e31c69ae933","Type":"ContainerStarted","Data":"700fe306727008107363f68d9dce81d2aa5ef243f604e695eb5f07cedcc0518b"}
Jul 29 06:23:50.168328 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:50.168293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m7dhw" event={"ID":"64ae52ce-78bf-414a-b277-c410b351ac9d","Type":"ContainerStarted","Data":"e150d67d6be23496f50e54a716eeab24205ddffe4d34da8b9d0384cc600843dd"}
Jul 29 06:23:50.169764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:50.169739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvlsn" event={"ID":"b4debcc9-5283-404d-9a73-1e31c69ae933","Type":"ContainerStarted","Data":"4c2ad93f3be2578925ba02a8bbd8d8940a7e3293f8f78502bd044aa2328b4a73"}
Jul 29 06:23:50.169877 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:50.169862    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:23:50.182476 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:50.182431    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m7dhw" podStartSLOduration=66.787938412 podStartE2EDuration="1m11.182411743s" totalImagesPullingTime="4.394473331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:50.181864339 +0000 UTC m=+71.817456142" watchObservedRunningTime="2026-07-29 06:23:50.182411743 +0000 UTC m=+71.818003534"
Jul 29 06:23:50.194234 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:23:50.194185    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gvlsn" podStartSLOduration=66.78625177 podStartE2EDuration="1m11.194170616s" totalImagesPullingTime="4.407918846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:23:50.193672443 +0000 UTC m=+71.829264233" watchObservedRunningTime="2026-07-29 06:23:50.194170616 +0000 UTC m=+71.829762407"
Jul 29 06:24:10.215675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.215554    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"]
Jul 29 06:24:10.219749 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.219729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.221885 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.221860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 06:24:10.222011 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.221862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 06:24:10.223062 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.223046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4sc5s\""
Jul 29 06:24:10.223165 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.223114    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 06:24:10.223165 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.223126    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 06:24:10.227435 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.227414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"]
Jul 29 06:24:10.309211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.309177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfj94\" (UniqueName: \"kubernetes.io/projected/24b7ad2e-b000-45c9-8049-3a90e56b60f9-kube-api-access-lfj94\") pod \"managed-serviceaccount-addon-agent-66f4df9594-wwwzh\" (UID: \"24b7ad2e-b000-45c9-8049-3a90e56b60f9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.309211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.309226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24b7ad2e-b000-45c9-8049-3a90e56b60f9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66f4df9594-wwwzh\" (UID: \"24b7ad2e-b000-45c9-8049-3a90e56b60f9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.410481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.410449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24b7ad2e-b000-45c9-8049-3a90e56b60f9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66f4df9594-wwwzh\" (UID: \"24b7ad2e-b000-45c9-8049-3a90e56b60f9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.410613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.410517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfj94\" (UniqueName: \"kubernetes.io/projected/24b7ad2e-b000-45c9-8049-3a90e56b60f9-kube-api-access-lfj94\") pod \"managed-serviceaccount-addon-agent-66f4df9594-wwwzh\" (UID: \"24b7ad2e-b000-45c9-8049-3a90e56b60f9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.413096 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.413076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24b7ad2e-b000-45c9-8049-3a90e56b60f9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66f4df9594-wwwzh\" (UID: \"24b7ad2e-b000-45c9-8049-3a90e56b60f9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.418043 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.418023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfj94\" (UniqueName: \"kubernetes.io/projected/24b7ad2e-b000-45c9-8049-3a90e56b60f9-kube-api-access-lfj94\") pod \"managed-serviceaccount-addon-agent-66f4df9594-wwwzh\" (UID: \"24b7ad2e-b000-45c9-8049-3a90e56b60f9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.542891 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.542789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"
Jul 29 06:24:10.665875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:10.665844    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh"]
Jul 29 06:24:10.668965 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:24:10.668929    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24b7ad2e_b000_45c9_8049_3a90e56b60f9.slice/crio-f1877e1e572f6dc8b76c15f15cc74cf2bff6a63389b5edcc701b93cf1e7b50b0 WatchSource:0}: Error finding container f1877e1e572f6dc8b76c15f15cc74cf2bff6a63389b5edcc701b93cf1e7b50b0: Status 404 returned error can't find the container with id f1877e1e572f6dc8b76c15f15cc74cf2bff6a63389b5edcc701b93cf1e7b50b0
Jul 29 06:24:11.222873 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:11.222735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh" event={"ID":"24b7ad2e-b000-45c9-8049-3a90e56b60f9","Type":"ContainerStarted","Data":"f1877e1e572f6dc8b76c15f15cc74cf2bff6a63389b5edcc701b93cf1e7b50b0"}
Jul 29 06:24:14.231734 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:14.231676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh" event={"ID":"24b7ad2e-b000-45c9-8049-3a90e56b60f9","Type":"ContainerStarted","Data":"7eb9e8c2efb6a02f2c8d9d7f9691168e71d3305840d16b23bda1ecb8c5fb5a2b"}
Jul 29 06:24:14.246153 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:14.246102    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh" podStartSLOduration=1.7244488059999998 podStartE2EDuration="4.246083278s" totalImagesPullingTime="2.521634472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:24:14.245597824 +0000 UTC m=+95.881189625" watchObservedRunningTime="2026-07-29 06:24:14.246083278 +0000 UTC m=+95.881675068"
Jul 29 06:24:17.166939 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:17.166896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:24:17.167318 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:24:17.167055    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:24:17.167318 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:24:17.167135    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:25:21.167116644 +0000 UTC m=+162.802708416 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:24:21.174339 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:21.174309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gvlsn"
Jul 29 06:24:48.686954 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:24:48.686899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:24:48.687378 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:24:48.687053    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 06:24:48.687378 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:24:48.687119    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:50.687102997 +0000 UTC m=+252.322694766 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : secret "metrics-daemon-secret" not found
Jul 29 06:25:16.288775 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:25:16.288701    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5rxmn" podUID="85cfbced-8f75-4d1a-b9eb-601c8b10140d"
Jul 29 06:25:16.379551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:25:16.379525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:25:17.918624 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:25:17.918557    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:25:21.202440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:25:21.202384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:25:21.202892 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:25:21.202532    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 06:25:21.202892 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:25:21.202597    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls podName:85cfbced-8f75-4d1a-b9eb-601c8b10140d nodeName:}" failed. No retries permitted until 2026-07-29 06:27:23.20257999 +0000 UTC m=+284.838171787 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls") pod "dns-default-5rxmn" (UID: "85cfbced-8f75-4d1a-b9eb-601c8b10140d") : secret "dns-default-metrics-tls" not found
Jul 29 06:25:32.898612 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:25:32.898520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:26:13.512855 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:13.512817    2578 generic.go:356] "Generic (PLEG): container finished" podID="24b7ad2e-b000-45c9-8049-3a90e56b60f9" containerID="7eb9e8c2efb6a02f2c8d9d7f9691168e71d3305840d16b23bda1ecb8c5fb5a2b" exitCode=255
Jul 29 06:26:13.513345 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:13.512896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh" event={"ID":"24b7ad2e-b000-45c9-8049-3a90e56b60f9","Type":"ContainerDied","Data":"7eb9e8c2efb6a02f2c8d9d7f9691168e71d3305840d16b23bda1ecb8c5fb5a2b"}
Jul 29 06:26:13.518540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:13.518521    2578 scope.go:117] "RemoveContainer" containerID="7eb9e8c2efb6a02f2c8d9d7f9691168e71d3305840d16b23bda1ecb8c5fb5a2b"
Jul 29 06:26:14.517806 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:14.517772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66f4df9594-wwwzh" event={"ID":"24b7ad2e-b000-45c9-8049-3a90e56b60f9","Type":"ContainerStarted","Data":"e01aeab1ff752c5ade20782b015386b3e215bac87542063cde5d96f98eb4014f"}
Jul 29 06:26:38.099288 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.099253    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-d8mbm"]
Jul 29 06:26:38.101925 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.101908    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-cf88d7cdf-w5kz2"]
Jul 29 06:26:38.102090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.102071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.104511 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.104494    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.105991 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.105971    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 06:26:38.106084 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.105987    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k72xg\""
Jul 29 06:26:38.106084 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.105992    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 06:26:38.106233 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.106219    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 06:26:38.106426 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.106410    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:26:38.107119 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.107105    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 06:26:38.107219 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.107206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 06:26:38.107626 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.107607    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 06:26:38.107701 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.107615    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fnj7x\""
Jul 29 06:26:38.108146 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.108092    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 06:26:38.108146 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.108099    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 06:26:38.108250 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.108205    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 06:26:38.111962 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.111942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 06:26:38.117023 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.116995    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-d8mbm"]
Jul 29 06:26:38.118083 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.118065    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cf88d7cdf-w5kz2"]
Jul 29 06:26:38.190316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.190286    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"]
Jul 29 06:26:38.193235 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.193214    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"]
Jul 29 06:26:38.193346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.193329    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.195726 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.195697    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"]
Jul 29 06:26:38.195868 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.195851    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.196090 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.196048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-56z7b\""
Jul 29 06:26:38.196469 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.196450    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 06:26:38.196551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.196497    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 06:26:38.196551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.196513    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:26:38.198081 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:26:38.198183 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198103    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 06:26:38.198183 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ppxqq\""
Jul 29 06:26:38.198293 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198244    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 06:26:38.198348 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198306    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 06:26:38.198506 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198489    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64d47f847b-9vpnz"]
Jul 29 06:26:38.198575 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.198554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"
Jul 29 06:26:38.200676 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.200659    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:26:38.200782 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.200759    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 06:26:38.200977 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.200959    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-47vkt\""
Jul 29 06:26:38.201138 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.201126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.203175 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.203160    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 06:26:38.203315 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.203299    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 06:26:38.203691 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.203674    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtwx9\""
Jul 29 06:26:38.204793 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.204775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 06:26:38.205977 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.205953    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"]
Jul 29 06:26:38.206999 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.206982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"]
Jul 29 06:26:38.208000 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.207980    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"]
Jul 29 06:26:38.209636 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.209615    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 06:26:38.211484 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.211465    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d47f847b-9vpnz"]
Jul 29 06:26:38.219483 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2xb\" (UniqueName: \"kubernetes.io/projected/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-kube-api-access-fw2xb\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.219562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22bfb0fa-29e7-4903-af08-feb60505151a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.219562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.219562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-stats-auth\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.219562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-serving-cert\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.219760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-default-certificate\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.219760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wvx\" (UniqueName: \"kubernetes.io/projected/22bfb0fa-29e7-4903-af08-feb60505151a-kube-api-access-n5wvx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.219760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.219760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.219760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22bfb0fa-29e7-4903-af08-feb60505151a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.219760 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mt2x\" (UniqueName: \"kubernetes.io/projected/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-kube-api-access-4mt2x\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.219969 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-config\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.219969 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8jd\" (UniqueName: \"kubernetes.io/projected/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-kube-api-access-mc8jd\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.219969 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.219866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-trusted-ca\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.320613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22bfb0fa-29e7-4903-af08-feb60505151a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.320613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-config\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.320892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8jd\" (UniqueName: \"kubernetes.io/projected/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-kube-api-access-mc8jd\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.320892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.320892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2xb\" (UniqueName: \"kubernetes.io/projected/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-kube-api-access-fw2xb\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.320892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.320892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-default-certificate\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.320903    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-trusted-ca\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.320957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-installation-pull-secrets\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.320975    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls podName:ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b nodeName:}" failed. No retries permitted until 2026-07-29 06:26:38.820955156 +0000 UTC m=+240.456546941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls") pod "cluster-samples-operator-6748489656-jbgdr" (UID: "ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b") : secret "samples-operator-tls" not found
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fs7r\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-kube-api-access-5fs7r\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-image-registry-private-configuration\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mt2x\" (UniqueName: \"kubernetes.io/projected/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-kube-api-access-4mt2x\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.321159    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:38.821138526 +0000 UTC m=+240.456730318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : configmap references non-existent config key: service-ca.crt
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-trusted-ca\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22bfb0fa-29e7-4903-af08-feb60505151a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-bound-sa-token\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.321227    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.321305    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:38.821282758 +0000 UTC m=+240.456874527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : secret "router-metrics-certs-default" not found
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wvx\" (UniqueName: \"kubernetes.io/projected/22bfb0fa-29e7-4903-af08-feb60505151a-kube-api-access-n5wvx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22bfb0fa-29e7-4903-af08-feb60505151a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.321413 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jknqc\" (UniqueName: \"kubernetes.io/projected/5df96dad-0811-4955-81e8-f0a855e3bc9a-kube-api-access-jknqc\") pod \"volume-data-source-validator-549c6d54cf-g82x6\" (UID: \"5df96dad-0811-4955-81e8-f0a855e3bc9a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"
Jul 29 06:26:38.321950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c36af936-5be7-4329-84fb-4dc176f901a3-ca-trust-extracted\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-stats-auth\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.321950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-registry-certificates\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.321950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-serving-cert\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.321950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321806    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-config\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.321950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.321828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-trusted-ca\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.323678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.323656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-default-certificate\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.323792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.323728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22bfb0fa-29e7-4903-af08-feb60505151a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.323892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.323872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-serving-cert\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.323974 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.323960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-stats-auth\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.329182 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.329159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8jd\" (UniqueName: \"kubernetes.io/projected/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-kube-api-access-mc8jd\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.329863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.329826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mt2x\" (UniqueName: \"kubernetes.io/projected/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-kube-api-access-4mt2x\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.330130 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.330107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wvx\" (UniqueName: \"kubernetes.io/projected/22bfb0fa-29e7-4903-af08-feb60505151a-kube-api-access-n5wvx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf\" (UID: \"22bfb0fa-29e7-4903-af08-feb60505151a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.330793 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.330770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2xb\" (UniqueName: \"kubernetes.io/projected/ac690d0e-c824-4b8b-9f44-f4f69a1eef7f-kube-api-access-fw2xb\") pod \"console-operator-584dcb6b54-d8mbm\" (UID: \"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f\") " pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.412895 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.412868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:38.422353 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-registry-certificates\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-installation-pull-secrets\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fs7r\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-kube-api-access-5fs7r\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422620 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-image-registry-private-configuration\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422620 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-trusted-ca\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422620 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-bound-sa-token\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.422620 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jknqc\" (UniqueName: \"kubernetes.io/projected/5df96dad-0811-4955-81e8-f0a855e3bc9a-kube-api-access-jknqc\") pod \"volume-data-source-validator-549c6d54cf-g82x6\" (UID: \"5df96dad-0811-4955-81e8-f0a855e3bc9a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"
Jul 29 06:26:38.422620 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.422581    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 06:26:38.422620 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.422597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c36af936-5be7-4329-84fb-4dc176f901a3-ca-trust-extracted\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.423118 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.422601    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d47f847b-9vpnz: secret "image-registry-tls" not found
Jul 29 06:26:38.423118 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.422689    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls podName:c36af936-5be7-4329-84fb-4dc176f901a3 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:38.922670379 +0000 UTC m=+240.558262149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls") pod "image-registry-64d47f847b-9vpnz" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3") : secret "image-registry-tls" not found
Jul 29 06:26:38.423118 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.423022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-registry-certificates\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.423272 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.423161    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c36af936-5be7-4329-84fb-4dc176f901a3-ca-trust-extracted\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.423787 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.423762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-trusted-ca\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.425263 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.425240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-installation-pull-secrets\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.425342 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.425280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-image-registry-private-configuration\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.431476 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.431443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-bound-sa-token\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.431565 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.431493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fs7r\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-kube-api-access-5fs7r\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.431624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.431561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jknqc\" (UniqueName: \"kubernetes.io/projected/5df96dad-0811-4955-81e8-f0a855e3bc9a-kube-api-access-jknqc\") pod \"volume-data-source-validator-549c6d54cf-g82x6\" (UID: \"5df96dad-0811-4955-81e8-f0a855e3bc9a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"
Jul 29 06:26:38.513382 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.513355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"
Jul 29 06:26:38.519626 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.519594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"
Jul 29 06:26:38.540477 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.540436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-d8mbm"]
Jul 29 06:26:38.543289 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:26:38.543251    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac690d0e_c824_4b8b_9f44_f4f69a1eef7f.slice/crio-e1628837e6fab90896a7ddd58f0c684d8fe8d6b3ff2febe650db68b0d93555d4 WatchSource:0}: Error finding container e1628837e6fab90896a7ddd58f0c684d8fe8d6b3ff2febe650db68b0d93555d4: Status 404 returned error can't find the container with id e1628837e6fab90896a7ddd58f0c684d8fe8d6b3ff2febe650db68b0d93555d4
Jul 29 06:26:38.584899 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.584842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" event={"ID":"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f","Type":"ContainerStarted","Data":"e1628837e6fab90896a7ddd58f0c684d8fe8d6b3ff2febe650db68b0d93555d4"}
Jul 29 06:26:38.647635 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.647604    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf"]
Jul 29 06:26:38.650626 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:26:38.650604    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bfb0fa_29e7_4903_af08_feb60505151a.slice/crio-1fc49caa5d7a5f7a3ec0cc87eba37217520a813b70685706991ebb3971dc704f WatchSource:0}: Error finding container 1fc49caa5d7a5f7a3ec0cc87eba37217520a813b70685706991ebb3971dc704f: Status 404 returned error can't find the container with id 1fc49caa5d7a5f7a3ec0cc87eba37217520a813b70685706991ebb3971dc704f
Jul 29 06:26:38.659321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.659298    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6"]
Jul 29 06:26:38.665297 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:26:38.665273    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df96dad_0811_4955_81e8_f0a855e3bc9a.slice/crio-7b5cb1ed8afd5ad5d9f3d3e756ebd399711422bd65bfbab0ef6611906ff65a14 WatchSource:0}: Error finding container 7b5cb1ed8afd5ad5d9f3d3e756ebd399711422bd65bfbab0ef6611906ff65a14: Status 404 returned error can't find the container with id 7b5cb1ed8afd5ad5d9f3d3e756ebd399711422bd65bfbab0ef6611906ff65a14
Jul 29 06:26:38.825664 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.825638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:38.825824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.825688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.825824 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.825793    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 06:26:38.825890 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.825795    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:39.825783053 +0000 UTC m=+241.461374822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : configmap references non-existent config key: service-ca.crt
Jul 29 06:26:38.825890 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.825854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:38.825998 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.825925    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 06:26:38.825998 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.825929    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls podName:ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b nodeName:}" failed. No retries permitted until 2026-07-29 06:26:39.825918644 +0000 UTC m=+241.461510413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls") pod "cluster-samples-operator-6748489656-jbgdr" (UID: "ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b") : secret "samples-operator-tls" not found
Jul 29 06:26:38.825998 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.825965    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:39.825955281 +0000 UTC m=+241.461547049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : secret "router-metrics-certs-default" not found
Jul 29 06:26:38.927060 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:38.926976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:38.927185 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.927115    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 06:26:38.927185 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.927130    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d47f847b-9vpnz: secret "image-registry-tls" not found
Jul 29 06:26:38.927185 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:38.927176    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls podName:c36af936-5be7-4329-84fb-4dc176f901a3 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:39.927162653 +0000 UTC m=+241.562754423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls") pod "image-registry-64d47f847b-9vpnz" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3") : secret "image-registry-tls" not found
Jul 29 06:26:39.591511 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:39.591460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6" event={"ID":"5df96dad-0811-4955-81e8-f0a855e3bc9a","Type":"ContainerStarted","Data":"7b5cb1ed8afd5ad5d9f3d3e756ebd399711422bd65bfbab0ef6611906ff65a14"}
Jul 29 06:26:39.593581 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:39.593524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf" event={"ID":"22bfb0fa-29e7-4903-af08-feb60505151a","Type":"ContainerStarted","Data":"1fc49caa5d7a5f7a3ec0cc87eba37217520a813b70685706991ebb3971dc704f"}
Jul 29 06:26:39.834134 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:39.834045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:39.834326 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.834161    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 06:26:39.834326 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:39.834195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:39.834326 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.834231    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls podName:ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b nodeName:}" failed. No retries permitted until 2026-07-29 06:26:41.834212285 +0000 UTC m=+243.469804084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls") pod "cluster-samples-operator-6748489656-jbgdr" (UID: "ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b") : secret "samples-operator-tls" not found
Jul 29 06:26:39.834326 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:39.834271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:39.834326 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.834277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:41.834265257 +0000 UTC m=+243.469857039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : configmap references non-existent config key: service-ca.crt
Jul 29 06:26:39.834600 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.834353    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 06:26:39.834600 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.834390    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:41.834380544 +0000 UTC m=+243.469972313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : secret "router-metrics-certs-default" not found
Jul 29 06:26:39.934948 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:39.934917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:39.935108 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.935085    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 06:26:39.935175 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.935111    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d47f847b-9vpnz: secret "image-registry-tls" not found
Jul 29 06:26:39.935215 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:39.935182    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls podName:c36af936-5be7-4329-84fb-4dc176f901a3 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:41.935161655 +0000 UTC m=+243.570753444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls") pod "image-registry-64d47f847b-9vpnz" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3") : secret "image-registry-tls" not found
Jul 29 06:26:40.598484 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:40.598438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6" event={"ID":"5df96dad-0811-4955-81e8-f0a855e3bc9a","Type":"ContainerStarted","Data":"b1baf25a815f7240fcdb40683b32a4b121d524eb4168ca4c5f33b31ad0fed488"}
Jul 29 06:26:40.613141 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:40.613093    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-g82x6" podStartSLOduration=1.365311451 podStartE2EDuration="2.613076989s" totalImagesPullingTime="1.247765538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:26:40.61204136 +0000 UTC m=+242.247633173" watchObservedRunningTime="2026-07-29 06:26:40.613076989 +0000 UTC m=+242.248668779"
Jul 29 06:26:41.603704 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.603621    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/0.log"
Jul 29 06:26:41.603704 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.603659    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f" containerID="23f4f995fd86918068592f1413ab231f6b989aae954fcd9a6cee6543061f7aed" exitCode=255
Jul 29 06:26:41.604162 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.603764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" event={"ID":"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f","Type":"ContainerDied","Data":"23f4f995fd86918068592f1413ab231f6b989aae954fcd9a6cee6543061f7aed"}
Jul 29 06:26:41.604162 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.604036    2578 scope.go:117] "RemoveContainer" containerID="23f4f995fd86918068592f1413ab231f6b989aae954fcd9a6cee6543061f7aed"
Jul 29 06:26:41.605316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.605294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf" event={"ID":"22bfb0fa-29e7-4903-af08-feb60505151a","Type":"ContainerStarted","Data":"ffa7e10de4062339f8a7b7915ba0f1952a4e5a7d5137a51c5f364207d6ed591f"}
Jul 29 06:26:41.633456 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.633408    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf" podStartSLOduration=1.008329232 podStartE2EDuration="3.633385128s" totalImagesPullingTime="2.625055896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:26:41.632755832 +0000 UTC m=+243.268347623" watchObservedRunningTime="2026-07-29 06:26:41.633385128 +0000 UTC m=+243.268976896"
Jul 29 06:26:41.851590 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.851544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:41.851797 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.851603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:41.851797 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.851629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:41.851797 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.851702    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 06:26:41.851797 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.851726    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 06:26:41.852016 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.851801    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:45.851778798 +0000 UTC m=+247.487370590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : configmap references non-existent config key: service-ca.crt
Jul 29 06:26:41.852016 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.851819    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:45.851811319 +0000 UTC m=+247.487403091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : secret "router-metrics-certs-default" not found
Jul 29 06:26:41.852016 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.851834    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls podName:ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b nodeName:}" failed. No retries permitted until 2026-07-29 06:26:45.851827131 +0000 UTC m=+247.487418900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls") pod "cluster-samples-operator-6748489656-jbgdr" (UID: "ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b") : secret "samples-operator-tls" not found
Jul 29 06:26:41.952150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:41.952119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:41.952285 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.952266    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 06:26:41.952285 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.952284    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d47f847b-9vpnz: secret "image-registry-tls" not found
Jul 29 06:26:41.952370 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:41.952340    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls podName:c36af936-5be7-4329-84fb-4dc176f901a3 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:45.952324921 +0000 UTC m=+247.587916694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls") pod "image-registry-64d47f847b-9vpnz" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3") : secret "image-registry-tls" not found
Jul 29 06:26:42.173533 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.173493    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t5jmq"]
Jul 29 06:26:42.176984 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.176967    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.179914 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.179882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 06:26:42.179914 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.179900    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 06:26:42.180097 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.179894    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 06:26:42.180156 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.180130    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 06:26:42.180209 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.180184    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-75z2t\""
Jul 29 06:26:42.189284 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.189263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t5jmq"]
Jul 29 06:26:42.255449 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.255352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vpq\" (UniqueName: \"kubernetes.io/projected/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-api-access-x8vpq\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.255605 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.255496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-crio-socket\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.255605 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.255566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.255605 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.255600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.255754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.255648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-data-volume\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.356498 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.356678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.356678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-data-volume\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.356678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vpq\" (UniqueName: \"kubernetes.io/projected/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-api-access-x8vpq\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.356678 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.356578    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 06:26:42.356678 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.356637    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:42.856621853 +0000 UTC m=+244.492213622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : configmap "kube-rbac-proxy" not found
Jul 29 06:26:42.357109 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.356679    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:42.357109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-crio-socket\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.357109 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.356753    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:42.856736651 +0000 UTC m=+244.492328421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:42.357109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-crio-socket\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.357109 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.356963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-data-volume\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.367040 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.367016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vpq\" (UniqueName: \"kubernetes.io/projected/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-api-access-x8vpq\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.611908 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.611887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/1.log"
Jul 29 06:26:42.612336 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.612328    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/0.log"
Jul 29 06:26:42.612376 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.612361    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f" containerID="76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa" exitCode=255
Jul 29 06:26:42.612448 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.612432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" event={"ID":"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f","Type":"ContainerDied","Data":"76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa"}
Jul 29 06:26:42.612483 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.612476    2578 scope.go:117] "RemoveContainer" containerID="23f4f995fd86918068592f1413ab231f6b989aae954fcd9a6cee6543061f7aed"
Jul 29 06:26:42.612660 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.612640    2578 scope.go:117] "RemoveContainer" containerID="76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa"
Jul 29 06:26:42.612907 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.612873    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-d8mbm_openshift-console-operator(ac690d0e-c824-4b8b-9f44-f4f69a1eef7f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podUID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f"
Jul 29 06:26:42.861030 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.860992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.861216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:42.861049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:42.861216 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.861117    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 06:26:42.861216 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.861184    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:43.861168428 +0000 UTC m=+245.496760200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : configmap "kube-rbac-proxy" not found
Jul 29 06:26:42.861216 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.861195    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:42.861358 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:42.861245    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:43.86123298 +0000 UTC m=+245.496824749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:43.616122 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:43.616093    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/1.log"
Jul 29 06:26:43.616485 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:43.616389    2578 scope.go:117] "RemoveContainer" containerID="76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa"
Jul 29 06:26:43.616551 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:43.616531    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-d8mbm_openshift-console-operator(ac690d0e-c824-4b8b-9f44-f4f69a1eef7f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podUID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f"
Jul 29 06:26:43.870437 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:43.870354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:43.870437 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:43.870399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:43.870615 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:43.870471    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 06:26:43.870615 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:43.870543    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:43.870615 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:43.870548    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:45.870528534 +0000 UTC m=+247.506120302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : configmap "kube-rbac-proxy" not found
Jul 29 06:26:43.870615 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:43.870584    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:45.870574298 +0000 UTC m=+247.506166067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:44.173509 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:44.173443    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rtlff_eb6a007a-7076-40ca-9e91-63b8230a6213/dns-node-resolver/0.log"
Jul 29 06:26:45.156592 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.156565    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cx94n_84996c51-2a76-484c-8fc3-5eff65bab848/node-ca/0.log"
Jul 29 06:26:45.174811 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.174777    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-l9mf8"]
Jul 29 06:26:45.179134 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.179119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.182125 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.182096    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 06:26:45.182125 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.182125    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 06:26:45.182285 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.182124    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 06:26:45.183396 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.183381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wdcjr\""
Jul 29 06:26:45.183444 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.183404    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 06:26:45.185885 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.185860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-l9mf8"]
Jul 29 06:26:45.281274 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.281243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b72ba797-da14-4369-814c-22d2ce873044-signing-key\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.281455 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.281400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkq65\" (UniqueName: \"kubernetes.io/projected/b72ba797-da14-4369-814c-22d2ce873044-kube-api-access-kkq65\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.281455 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.281432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b72ba797-da14-4369-814c-22d2ce873044-signing-cabundle\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.382663 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.382625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkq65\" (UniqueName: \"kubernetes.io/projected/b72ba797-da14-4369-814c-22d2ce873044-kube-api-access-kkq65\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.382663 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.382668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b72ba797-da14-4369-814c-22d2ce873044-signing-cabundle\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.382900 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.382743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b72ba797-da14-4369-814c-22d2ce873044-signing-key\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.383399 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.383374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b72ba797-da14-4369-814c-22d2ce873044-signing-cabundle\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.385176 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.385151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b72ba797-da14-4369-814c-22d2ce873044-signing-key\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.390460 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.390436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkq65\" (UniqueName: \"kubernetes.io/projected/b72ba797-da14-4369-814c-22d2ce873044-kube-api-access-kkq65\") pod \"service-ca-658d7b7c78-l9mf8\" (UID: \"b72ba797-da14-4369-814c-22d2ce873044\") " pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.489135 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.489051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8"
Jul 29 06:26:45.610682 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.610653    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-l9mf8"]
Jul 29 06:26:45.613748 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:26:45.613723    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72ba797_da14_4369_814c_22d2ce873044.slice/crio-bf0cd8f820861bc7338cf8bf1e7156d9d9fdecf821daca0caeef6cfa20f63bc1 WatchSource:0}: Error finding container bf0cd8f820861bc7338cf8bf1e7156d9d9fdecf821daca0caeef6cfa20f63bc1: Status 404 returned error can't find the container with id bf0cd8f820861bc7338cf8bf1e7156d9d9fdecf821daca0caeef6cfa20f63bc1
Jul 29 06:26:45.622903 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.622879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8" event={"ID":"b72ba797-da14-4369-814c-22d2ce873044","Type":"ContainerStarted","Data":"bf0cd8f820861bc7338cf8bf1e7156d9d9fdecf821daca0caeef6cfa20f63bc1"}
Jul 29 06:26:45.888314 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.888287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:45.888461 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.888338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:45.888461 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.888361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:45.888461 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.888393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:45.888461 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.888428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:45.888461 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888431    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888485    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888498    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:49.888477424 +0000 UTC m=+251.524069194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : configmap "kube-rbac-proxy" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888432    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888527    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:53.888512371 +0000 UTC m=+255.524104144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : configmap references non-existent config key: service-ca.crt
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888532    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888548    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls podName:ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b nodeName:}" failed. No retries permitted until 2026-07-29 06:26:53.888537162 +0000 UTC m=+255.524128931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls") pod "cluster-samples-operator-6748489656-jbgdr" (UID: "ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b") : secret "samples-operator-tls" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888561    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:49.888555058 +0000 UTC m=+251.524146827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:45.888618 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.888574    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:26:53.888566469 +0000 UTC m=+255.524158237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : secret "router-metrics-certs-default" not found
Jul 29 06:26:45.954463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.954439    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9nk9_44d59680-97e5-4bb5-afbb-e8f05a4806fa/serve-healthcheck-canary/0.log"
Jul 29 06:26:45.989746 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:45.989695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:45.989877 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.989842    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 06:26:45.989877 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.989856    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d47f847b-9vpnz: secret "image-registry-tls" not found
Jul 29 06:26:45.989939 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:45.989908    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls podName:c36af936-5be7-4329-84fb-4dc176f901a3 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:53.989893115 +0000 UTC m=+255.625484888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls") pod "image-registry-64d47f847b-9vpnz" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3") : secret "image-registry-tls" not found
Jul 29 06:26:48.414042 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:48.413962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:48.414042 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:48.414025    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:26:48.414416 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:48.414350    2578 scope.go:117] "RemoveContainer" containerID="76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa"
Jul 29 06:26:48.414519 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:48.414497    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-d8mbm_openshift-console-operator(ac690d0e-c824-4b8b-9f44-f4f69a1eef7f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podUID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f"
Jul 29 06:26:48.636758 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:48.636724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8" event={"ID":"b72ba797-da14-4369-814c-22d2ce873044","Type":"ContainerStarted","Data":"0462e478d9b929f7bd31e92cf6ad9cb0bdc9b180d36210bf9df5881d93a8cc16"}
Jul 29 06:26:48.654910 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:48.654862    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-l9mf8" podStartSLOduration=1.597495756 podStartE2EDuration="3.654846112s" totalImagesPullingTime="2.057350356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:26:48.653414859 +0000 UTC m=+250.289006658" watchObservedRunningTime="2026-07-29 06:26:48.654846112 +0000 UTC m=+250.290437902"
Jul 29 06:26:49.925379 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:49.925337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:49.925792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:49.925391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:49.925792 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:49.925469    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 06:26:49.925792 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:49.925497    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:49.925792 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:49.925550    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:57.925528654 +0000 UTC m=+259.561120435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : configmap "kube-rbac-proxy" not found
Jul 29 06:26:49.925792 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:49.925568    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:26:57.925559606 +0000 UTC m=+259.561151387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:50.731548 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:50.731499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:26:50.731734 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:50.731658    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 06:26:50.731780 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:50.731742    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs podName:9951ac15-e995-42ad-9e96-669a8d362e11 nodeName:}" failed. No retries permitted until 2026-07-29 06:28:52.731725346 +0000 UTC m=+374.367317128 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs") pod "network-metrics-daemon-h4557" (UID: "9951ac15-e995-42ad-9e96-669a8d362e11") : secret "metrics-daemon-secret" not found
Jul 29 06:26:53.956339 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:53.956299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:53.956854 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:53.956366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:53.956854 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:53.956420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:53.956854 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:53.956508    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle podName:ecc4b76d-788a-4a4a-87cd-4dacab9c514f nodeName:}" failed. No retries permitted until 2026-07-29 06:27:09.956476939 +0000 UTC m=+271.592068711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle") pod "router-default-cf88d7cdf-w5kz2" (UID: "ecc4b76d-788a-4a4a-87cd-4dacab9c514f") : configmap references non-existent config key: service-ca.crt
Jul 29 06:26:53.958981 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:53.958962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-metrics-certs\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:26:53.959048 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:53.958968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jbgdr\" (UID: \"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:54.057220 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.057180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:54.059828 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.059802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"image-registry-64d47f847b-9vpnz\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") " pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:54.106094 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.106063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-56z7b\""
Jul 29 06:26:54.113945 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.113921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"
Jul 29 06:26:54.126454 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.126435    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtwx9\""
Jul 29 06:26:54.134311 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.134281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:54.246680 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.246649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr"]
Jul 29 06:26:54.268344 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.268313    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d47f847b-9vpnz"]
Jul 29 06:26:54.271833 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:26:54.271810    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36af936_5be7_4329_84fb_4dc176f901a3.slice/crio-6237e3736089176765a79d4b9707734690b645e853abe06f13d71503dce7a177 WatchSource:0}: Error finding container 6237e3736089176765a79d4b9707734690b645e853abe06f13d71503dce7a177: Status 404 returned error can't find the container with id 6237e3736089176765a79d4b9707734690b645e853abe06f13d71503dce7a177
Jul 29 06:26:54.657293 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.657247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" event={"ID":"c36af936-5be7-4329-84fb-4dc176f901a3","Type":"ContainerStarted","Data":"3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7"}
Jul 29 06:26:54.657492 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.657306    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" event={"ID":"c36af936-5be7-4329-84fb-4dc176f901a3","Type":"ContainerStarted","Data":"6237e3736089176765a79d4b9707734690b645e853abe06f13d71503dce7a177"}
Jul 29 06:26:54.657492 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.657332    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:26:54.658542 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.658519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr" event={"ID":"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b","Type":"ContainerStarted","Data":"a0f29edf8a6957f6d7eb67780738551b1f108606b1ab6947e8472b8f72fde17b"}
Jul 29 06:26:54.675381 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:54.675327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" podStartSLOduration=16.675310416 podStartE2EDuration="16.675310416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:26:54.673858344 +0000 UTC m=+256.309450185" watchObservedRunningTime="2026-07-29 06:26:54.675310416 +0000 UTC m=+256.310902208"
Jul 29 06:26:56.667139 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:56.667100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr" event={"ID":"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b","Type":"ContainerStarted","Data":"870cc9c1921f85ee4c1f3132ea26b2b7e861ccea5bcf0a39db574d13ffdcf124"}
Jul 29 06:26:56.667524 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:56.667187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr" event={"ID":"ff880d2c-c5c6-4a35-8dc2-c9707c09dd8b","Type":"ContainerStarted","Data":"8dd699d8074b2aa0579c08d16a5f35eaea75cba270b7d4a17aa65934ca1fe390"}
Jul 29 06:26:56.682547 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:56.682498    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jbgdr" podStartSLOduration=16.719663811 podStartE2EDuration="18.682482073s" totalImagesPullingTime="1.962818262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:26:56.681593465 +0000 UTC m=+258.317185256" watchObservedRunningTime="2026-07-29 06:26:56.682482073 +0000 UTC m=+258.318073864"
Jul 29 06:26:57.990604 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:57.990569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:57.991104 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:57.990616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:26:57.991104 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:57.990769    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:57.991104 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:26:57.990823    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls podName:92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03 nodeName:}" failed. No retries permitted until 2026-07-29 06:27:13.99080827 +0000 UTC m=+275.626400040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t5jmq" (UID: "92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03") : secret "insights-runtime-extractor-tls" not found
Jul 29 06:26:57.991104 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:26:57.991084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:27:03.898990 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:03.898910    2578 scope.go:117] "RemoveContainer" containerID="76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa"
Jul 29 06:27:04.697822 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:04.697789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:27:04.698219 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:04.698203    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/1.log"
Jul 29 06:27:04.698283 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:04.698236    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f" containerID="1426ef503879a9176e5e070355a8bb7c317c76aee7ea1af3351d121e95ef7053" exitCode=255
Jul 29 06:27:04.698317 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:04.698299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" event={"ID":"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f","Type":"ContainerDied","Data":"1426ef503879a9176e5e070355a8bb7c317c76aee7ea1af3351d121e95ef7053"}
Jul 29 06:27:04.698354 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:04.698344    2578 scope.go:117] "RemoveContainer" containerID="76e9bfadd5cbdfbdfb48927b7f5830104a6aa2da7dfef345cc194123d705beaa"
Jul 29 06:27:04.698645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:04.698618    2578 scope.go:117] "RemoveContainer" containerID="1426ef503879a9176e5e070355a8bb7c317c76aee7ea1af3351d121e95ef7053"
Jul 29 06:27:04.698845 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:04.698815    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-d8mbm_openshift-console-operator(ac690d0e-c824-4b8b-9f44-f4f69a1eef7f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podUID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f"
Jul 29 06:27:05.703612 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:05.703584    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:27:06.247884 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:06.247844    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d47f847b-9vpnz"]
Jul 29 06:27:08.413563 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:08.413525    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:27:08.413982 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:08.413582    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:27:08.413982 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:08.413903    2578 scope.go:117] "RemoveContainer" containerID="1426ef503879a9176e5e070355a8bb7c317c76aee7ea1af3351d121e95ef7053"
Jul 29 06:27:08.414084 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:08.414062    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-d8mbm_openshift-console-operator(ac690d0e-c824-4b8b-9f44-f4f69a1eef7f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podUID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f"
Jul 29 06:27:09.982893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:09.982834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:09.983437 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:09.983417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecc4b76d-788a-4a4a-87cd-4dacab9c514f-service-ca-bundle\") pod \"router-default-cf88d7cdf-w5kz2\" (UID: \"ecc4b76d-788a-4a4a-87cd-4dacab9c514f\") " pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:10.221494 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:10.221462    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fnj7x\""
Jul 29 06:27:10.229376 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:10.229357    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:10.360564 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:10.360522    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cf88d7cdf-w5kz2"]
Jul 29 06:27:10.363078 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:10.363051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc4b76d_788a_4a4a_87cd_4dacab9c514f.slice/crio-863332bdf7125262de5a59d25267f11fd40d1cd639202abc52ae495b52f16619 WatchSource:0}: Error finding container 863332bdf7125262de5a59d25267f11fd40d1cd639202abc52ae495b52f16619: Status 404 returned error can't find the container with id 863332bdf7125262de5a59d25267f11fd40d1cd639202abc52ae495b52f16619
Jul 29 06:27:10.720274 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:10.720234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2" event={"ID":"ecc4b76d-788a-4a4a-87cd-4dacab9c514f","Type":"ContainerStarted","Data":"699feba9e0dd880ff58abc04dc1cb0135f9532ee11513e7b9f29f229c66a0064"}
Jul 29 06:27:10.720274 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:10.720281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2" event={"ID":"ecc4b76d-788a-4a4a-87cd-4dacab9c514f","Type":"ContainerStarted","Data":"863332bdf7125262de5a59d25267f11fd40d1cd639202abc52ae495b52f16619"}
Jul 29 06:27:10.737997 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:10.737936    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2" podStartSLOduration=32.737914892 podStartE2EDuration="32.737914892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:10.737561843 +0000 UTC m=+272.373153635" watchObservedRunningTime="2026-07-29 06:27:10.737914892 +0000 UTC m=+272.373506685"
Jul 29 06:27:11.229764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:11.229729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:11.232537 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:11.232516    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:11.724622 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:11.724592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:11.725844 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:11.725824    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-cf88d7cdf-w5kz2"
Jul 29 06:27:14.019065 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:14.019027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:27:14.021532 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:14.021513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t5jmq\" (UID: \"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03\") " pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:27:14.287269 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:14.287179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t5jmq"
Jul 29 06:27:14.422011 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:14.421977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t5jmq"]
Jul 29 06:27:14.424862 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:14.424832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d2a9d9_eca0_4583_93dd_0fa7f0f6ad03.slice/crio-b6c67ccc2edde5827784f9dec34a142de7bdb3045f56d9894284c2c96a41106e WatchSource:0}: Error finding container b6c67ccc2edde5827784f9dec34a142de7bdb3045f56d9894284c2c96a41106e: Status 404 returned error can't find the container with id b6c67ccc2edde5827784f9dec34a142de7bdb3045f56d9894284c2c96a41106e
Jul 29 06:27:14.734950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:14.734918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t5jmq" event={"ID":"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03","Type":"ContainerStarted","Data":"b6c67ccc2edde5827784f9dec34a142de7bdb3045f56d9894284c2c96a41106e"}
Jul 29 06:27:16.254667 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:16.254618    2578 patch_prober.go:28] interesting pod/image-registry-64d47f847b-9vpnz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 06:27:16.255154 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:16.254681    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 06:27:18.900796 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:18.900766    2578 scope.go:117] "RemoveContainer" containerID="1426ef503879a9176e5e070355a8bb7c317c76aee7ea1af3351d121e95ef7053"
Jul 29 06:27:18.901262 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:18.900962    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-d8mbm_openshift-console-operator(ac690d0e-c824-4b8b-9f44-f4f69a1eef7f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podUID="ac690d0e-c824-4b8b-9f44-f4f69a1eef7f"
Jul 29 06:27:19.380336 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:19.380289    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5rxmn" podUID="85cfbced-8f75-4d1a-b9eb-601c8b10140d"
Jul 29 06:27:19.758186 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:19.758101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:27:19.758186 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:19.758126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t5jmq" event={"ID":"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03","Type":"ContainerStarted","Data":"b893446b9f54c5295eec87f6d1d17cdd770c1f29947e3d96291dd491198ae6be"}
Jul 29 06:27:22.058572 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.057255    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ch5rp"]
Jul 29 06:27:22.079532 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.079498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.082149 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.082099    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 06:27:22.084729 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.084600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 06:27:22.084729 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.084653    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 06:27:22.084985 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.084964    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-chckx\""
Jul 29 06:27:22.085103 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.085006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 06:27:22.086101 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.085949    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 06:27:22.086101 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.085973    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 06:27:22.091052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.089867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-wtmp\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.091052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.089912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-root\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.091052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.089947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.094486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.094457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzjc5\" (UniqueName: \"kubernetes.io/projected/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-kube-api-access-mzjc5\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.094581 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.094516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-textfile\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.094581 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.094548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.094681 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.094588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-tls\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.094681 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.094660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-sys\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.094801 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.094754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-metrics-client-ca\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195785 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-sys\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-sys\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-metrics-client-ca\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-wtmp\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-root\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzjc5\" (UniqueName: \"kubernetes.io/projected/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-kube-api-access-mzjc5\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.195973 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-textfile\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-root\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.195987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.196020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-tls\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.196028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-wtmp\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196616 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.196346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-textfile\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196616 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.196522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-metrics-client-ca\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.196775 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.196690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.198768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.198745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-tls\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.198956 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.198933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.203784 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.203761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzjc5\" (UniqueName: \"kubernetes.io/projected/e9b776ff-9c5c-441d-986e-dc10ec51ae0b-kube-api-access-mzjc5\") pod \"node-exporter-ch5rp\" (UID: \"e9b776ff-9c5c-441d-986e-dc10ec51ae0b\") " pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:22.395642 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:22.395613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ch5rp"
Jul 29 06:27:23.073981 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:23.073949    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b776ff_9c5c_441d_986e_dc10ec51ae0b.slice/crio-db803d72e30ddc1506312b6db7ace1bb67dde438b60008b8f095c4425dc9cb49 WatchSource:0}: Error finding container db803d72e30ddc1506312b6db7ace1bb67dde438b60008b8f095c4425dc9cb49: Status 404 returned error can't find the container with id db803d72e30ddc1506312b6db7ace1bb67dde438b60008b8f095c4425dc9cb49
Jul 29 06:27:23.204019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.203996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:27:23.206311 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.206290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfbced-8f75-4d1a-b9eb-601c8b10140d-metrics-tls\") pod \"dns-default-5rxmn\" (UID: \"85cfbced-8f75-4d1a-b9eb-601c8b10140d\") " pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:27:23.361030 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.361008    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z5482\""
Jul 29 06:27:23.368769 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.368751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:27:23.492907 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.492878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rxmn"]
Jul 29 06:27:23.496284 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:23.496258    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cfbced_8f75_4d1a_b9eb_601c8b10140d.slice/crio-be0964bde267975e61c76c84a107520e54e8d20d11c6cc2274ba2143515a0974 WatchSource:0}: Error finding container be0964bde267975e61c76c84a107520e54e8d20d11c6cc2274ba2143515a0974: Status 404 returned error can't find the container with id be0964bde267975e61c76c84a107520e54e8d20d11c6cc2274ba2143515a0974
Jul 29 06:27:23.777179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.777090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ch5rp" event={"ID":"e9b776ff-9c5c-441d-986e-dc10ec51ae0b","Type":"ContainerStarted","Data":"db803d72e30ddc1506312b6db7ace1bb67dde438b60008b8f095c4425dc9cb49"}
Jul 29 06:27:23.779275 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.779243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t5jmq" event={"ID":"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03","Type":"ContainerStarted","Data":"a9e9e60b05fc1b735eeef1e32625e06d8b640873174f0be030ea5ef7d7606e6a"}
Jul 29 06:27:23.781044 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:23.781013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rxmn" event={"ID":"85cfbced-8f75-4d1a-b9eb-601c8b10140d","Type":"ContainerStarted","Data":"be0964bde267975e61c76c84a107520e54e8d20d11c6cc2274ba2143515a0974"}
Jul 29 06:27:24.014292 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.014258    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7889c996bb-xnblk"]
Jul 29 06:27:24.019497 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.019423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.022423 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022396    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bhjzp\""
Jul 29 06:27:24.022566 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 06:27:24.022566 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022403    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 06:27:24.022673 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 06:27:24.022818 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 06:27:24.022903 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022870    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 06:27:24.023004 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.022987    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2usi3vo11ahn7\""
Jul 29 06:27:24.029595 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.029297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7889c996bb-xnblk"]
Jul 29 06:27:24.113019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.112983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9kd7\" (UniqueName: \"kubernetes.io/projected/b0f092f9-debb-405f-9691-5b9da233fb94-kube-api-access-g9kd7\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-tls\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f092f9-debb-405f-9691-5b9da233fb94-metrics-client-ca\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-grpc-tls\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.113481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.113357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214339 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214478 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-grpc-tls\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214478 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214478 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9kd7\" (UniqueName: \"kubernetes.io/projected/b0f092f9-debb-405f-9691-5b9da233fb94-kube-api-access-g9kd7\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-tls\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.214645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.214630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f092f9-debb-405f-9691-5b9da233fb94-metrics-client-ca\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.215648 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.215621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f092f9-debb-405f-9691-5b9da233fb94-metrics-client-ca\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.218985 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.218909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.220054 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.220020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.220886 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.220862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.223091 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.223049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-tls\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.223192 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.223175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.224234 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.224208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0f092f9-debb-405f-9691-5b9da233fb94-secret-grpc-tls\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.224792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.224771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9kd7\" (UniqueName: \"kubernetes.io/projected/b0f092f9-debb-405f-9691-5b9da233fb94-kube-api-access-g9kd7\") pod \"thanos-querier-7889c996bb-xnblk\" (UID: \"b0f092f9-debb-405f-9691-5b9da233fb94\") " pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.332441 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.332343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:24.497218 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.497067    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7889c996bb-xnblk"]
Jul 29 06:27:24.500527 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:24.500329    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f092f9_debb_405f_9691_5b9da233fb94.slice/crio-40d8c7d7b1afcf76ffbcc45ef1cc603c12e11015458cd9120f552470778a3b4a WatchSource:0}: Error finding container 40d8c7d7b1afcf76ffbcc45ef1cc603c12e11015458cd9120f552470778a3b4a: Status 404 returned error can't find the container with id 40d8c7d7b1afcf76ffbcc45ef1cc603c12e11015458cd9120f552470778a3b4a
Jul 29 06:27:24.788985 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.788648    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9b776ff-9c5c-441d-986e-dc10ec51ae0b" containerID="72f34255fc75cbbb6bf40d882f2e53902252268a21eb9a25a2766515207deb26" exitCode=0
Jul 29 06:27:24.788985 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.788762    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ch5rp" event={"ID":"e9b776ff-9c5c-441d-986e-dc10ec51ae0b","Type":"ContainerDied","Data":"72f34255fc75cbbb6bf40d882f2e53902252268a21eb9a25a2766515207deb26"}
Jul 29 06:27:24.790540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:24.790505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"40d8c7d7b1afcf76ffbcc45ef1cc603c12e11015458cd9120f552470778a3b4a"}
Jul 29 06:27:25.798072 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:25.798032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ch5rp" event={"ID":"e9b776ff-9c5c-441d-986e-dc10ec51ae0b","Type":"ContainerStarted","Data":"94dbd11058b02c37883c35be2412a9ac529c89c04d0f05798852fb329fd0811e"}
Jul 29 06:27:25.798514 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:25.798091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ch5rp" event={"ID":"e9b776ff-9c5c-441d-986e-dc10ec51ae0b","Type":"ContainerStarted","Data":"d9038e7eb9d11e3e5039965d7fb143167f42b6bc8275ab0d6393a1b462617c9e"}
Jul 29 06:27:25.816180 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:25.816123    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ch5rp" podStartSLOduration=2.671869124 podStartE2EDuration="3.816107057s" totalImagesPullingTime="1.0664874s" totalInitContainerRuntime="77.750533ms" isStatefulPod=true podCreationTimestamp="2026-07-29 06:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:25.814517829 +0000 UTC m=+287.450109620" watchObservedRunningTime="2026-07-29 06:27:25.816107057 +0000 UTC m=+287.451698847"
Jul 29 06:27:26.254019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.253983    2578 patch_prober.go:28] interesting pod/image-registry-64d47f847b-9vpnz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 06:27:26.254194 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.254043    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 06:27:26.805427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.805388    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"]
Jul 29 06:27:26.820389 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.820350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"]
Jul 29 06:27:26.820556 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.820472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:26.823940 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.823483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 06:27:26.823940 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.823785    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2jqkm\""
Jul 29 06:27:26.938211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.938172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2g9\" (UniqueName: \"kubernetes.io/projected/0e9fe44d-eed8-49c5-958d-648ff7030ed5-kube-api-access-lr2g9\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:26.938381 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:26.938221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e9fe44d-eed8-49c5-958d-648ff7030ed5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:27.039556 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:27.039519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2g9\" (UniqueName: \"kubernetes.io/projected/0e9fe44d-eed8-49c5-958d-648ff7030ed5-kube-api-access-lr2g9\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:27.039768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:27.039588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e9fe44d-eed8-49c5-958d-648ff7030ed5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:27.039768 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:27.039731    2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 06:27:27.039898 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:27.039809    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9fe44d-eed8-49c5-958d-648ff7030ed5-monitoring-plugin-cert podName:0e9fe44d-eed8-49c5-958d-648ff7030ed5 nodeName:}" failed. No retries permitted until 2026-07-29 06:27:27.53978664 +0000 UTC m=+289.175378427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e9fe44d-eed8-49c5-958d-648ff7030ed5-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-7l6z2" (UID: "0e9fe44d-eed8-49c5-958d-648ff7030ed5") : secret "monitoring-plugin-cert" not found
Jul 29 06:27:27.048381 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:27.048347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2g9\" (UniqueName: \"kubernetes.io/projected/0e9fe44d-eed8-49c5-958d-648ff7030ed5-kube-api-access-lr2g9\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:27.543257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:27.543221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e9fe44d-eed8-49c5-958d-648ff7030ed5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:27.546123 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:27.546081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e9fe44d-eed8-49c5-958d-648ff7030ed5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-7l6z2\" (UID: \"0e9fe44d-eed8-49c5-958d-648ff7030ed5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:27.732869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:27.732828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:28.174077 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.173996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"]
Jul 29 06:27:28.186184 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:28.186156    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9fe44d_eed8_49c5_958d_648ff7030ed5.slice/crio-c5f6a256d20292dd5ca73929cd3c24b79e6e3a7c11f6eb3d9abc90faa339e76c WatchSource:0}: Error finding container c5f6a256d20292dd5ca73929cd3c24b79e6e3a7c11f6eb3d9abc90faa339e76c: Status 404 returned error can't find the container with id c5f6a256d20292dd5ca73929cd3c24b79e6e3a7c11f6eb3d9abc90faa339e76c
Jul 29 06:27:28.815968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.815904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"47593995a5b73980ae0839daaab4a7eac21bca6b0cdf8cd37716c9863573a309"}
Jul 29 06:27:28.816148 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.816022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"16e33d1a54ba2ee8d804260b40b58b86b8950ce104bc312221a9f7a7980a014e"}
Jul 29 06:27:28.816148 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.816065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"60c542ed55226db2d409fe3ee43d5796285416acc727c0a4d4f9f0d003e0f020"}
Jul 29 06:27:28.817895 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.817856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2" event={"ID":"0e9fe44d-eed8-49c5-958d-648ff7030ed5","Type":"ContainerStarted","Data":"c5f6a256d20292dd5ca73929cd3c24b79e6e3a7c11f6eb3d9abc90faa339e76c"}
Jul 29 06:27:28.820800 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.820768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t5jmq" event={"ID":"92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03","Type":"ContainerStarted","Data":"c9c2f7728ea1190c2a34d0a6369b1ad5de4ba07700789b95681c780acc20884e"}
Jul 29 06:27:28.823207 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.823169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rxmn" event={"ID":"85cfbced-8f75-4d1a-b9eb-601c8b10140d","Type":"ContainerStarted","Data":"2846fe0448e2373b29232fbf6d15becce0db5c620d919752fd9eea9d4a9fd53b"}
Jul 29 06:27:28.823323 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.823217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rxmn" event={"ID":"85cfbced-8f75-4d1a-b9eb-601c8b10140d","Type":"ContainerStarted","Data":"50b3d9d25a500cd9aa384f85a15eeab0c0e3aa7b33bdf10671f07a97a5d46cc9"}
Jul 29 06:27:28.823323 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.823271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:27:28.842217 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.842157    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t5jmq" podStartSLOduration=33.381163358 podStartE2EDuration="46.842083583s" totalImagesPullingTime="13.460920225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 06:26:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:28.840135764 +0000 UTC m=+290.475727556" watchObservedRunningTime="2026-07-29 06:27:28.842083583 +0000 UTC m=+290.477675375"
Jul 29 06:27:28.857337 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:28.857284    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5rxmn" podStartSLOduration=251.339789751 podStartE2EDuration="4m15.857263926s" totalImagesPullingTime="4.517474175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:28.856658816 +0000 UTC m=+290.492250608" watchObservedRunningTime="2026-07-29 06:27:28.857263926 +0000 UTC m=+290.492855718"
Jul 29 06:27:29.831302 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.831200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"f80d1034d5ea5cb843db5e610b4a1e2673bbb83491824efb39f9dbc172a33a24"}
Jul 29 06:27:29.831302 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.831283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"caced7782d06c61da1f36dc1fd695b1d73a044d00f8a28f4ad626c5e8751f898"}
Jul 29 06:27:29.831828 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.831326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" event={"ID":"b0f092f9-debb-405f-9691-5b9da233fb94","Type":"ContainerStarted","Data":"bccd799b5af08f29e1dd76df9b766dadd7817d8cc269b81ecfe31a6fabcc62bd"}
Jul 29 06:27:29.831828 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.831373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:29.833034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.833010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2" event={"ID":"0e9fe44d-eed8-49c5-958d-648ff7030ed5","Type":"ContainerStarted","Data":"2c11c619bdfeb53b3a9b7f83c493161ab67e793f426902d0f0d8d3df4cf26a3c"}
Jul 29 06:27:29.833465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.833446    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:29.838630 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.838609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2"
Jul 29 06:27:29.852787 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.852741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk" podStartSLOduration=2.503056881 podStartE2EDuration="6.852725547s" totalImagesPullingTime="4.349668666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:27:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:29.851108068 +0000 UTC m=+291.486699855" watchObservedRunningTime="2026-07-29 06:27:29.852725547 +0000 UTC m=+291.488317336"
Jul 29 06:27:29.870759 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:29.867878    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-7l6z2" podStartSLOduration=2.5681406129999997 podStartE2EDuration="3.867859621s" totalImagesPullingTime="1.299719008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:29.866513418 +0000 UTC m=+291.502105210" watchObservedRunningTime="2026-07-29 06:27:29.867859621 +0000 UTC m=+291.503451425"
Jul 29 06:27:31.266782 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.266737    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" containerName="registry" containerID="cri-o://3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7" gracePeriod=30
Jul 29 06:27:31.511292 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.511267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:27:31.578012 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.577922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578012 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.577964    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-registry-certificates\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578012 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.577994    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c36af936-5be7-4329-84fb-4dc176f901a3-ca-trust-extracted\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578273 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-installation-pull-secrets\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578273 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578078    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-image-registry-private-configuration\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578273 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578111    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fs7r\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-kube-api-access-5fs7r\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578273 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-trusted-ca\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578273 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-bound-sa-token\") pod \"c36af936-5be7-4329-84fb-4dc176f901a3\" (UID: \"c36af936-5be7-4329-84fb-4dc176f901a3\") "
Jul 29 06:27:31.578496 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578401    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:27:31.578615 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.578589    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:27:31.580776 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.580634    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:27:31.580776 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.580736    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:27:31.580948 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.580809    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-kube-api-access-5fs7r" (OuterVolumeSpecName: "kube-api-access-5fs7r") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "kube-api-access-5fs7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:27:31.580997 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.580964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:27:31.580997 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.580982    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:27:31.587128 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.587100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c36af936-5be7-4329-84fb-4dc176f901a3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c36af936-5be7-4329-84fb-4dc176f901a3" (UID: "c36af936-5be7-4329-84fb-4dc176f901a3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:27:31.679600 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679549    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-image-registry-private-configuration\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679600 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679591    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fs7r\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-kube-api-access-5fs7r\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679600 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679603    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-trusted-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679600 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679613    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-bound-sa-token\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679600 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679621    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c36af936-5be7-4329-84fb-4dc176f901a3-registry-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679913 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679630    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c36af936-5be7-4329-84fb-4dc176f901a3-registry-certificates\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679913 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679638    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c36af936-5be7-4329-84fb-4dc176f901a3-ca-trust-extracted\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.679913 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.679646    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c36af936-5be7-4329-84fb-4dc176f901a3-installation-pull-secrets\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:27:31.840860 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.840774    2578 generic.go:356] "Generic (PLEG): container finished" podID="c36af936-5be7-4329-84fb-4dc176f901a3" containerID="3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7" exitCode=0
Jul 29 06:27:31.840860 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.840815    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz"
Jul 29 06:27:31.840860 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.840857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" event={"ID":"c36af936-5be7-4329-84fb-4dc176f901a3","Type":"ContainerDied","Data":"3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7"}
Jul 29 06:27:31.841112 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.840898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d47f847b-9vpnz" event={"ID":"c36af936-5be7-4329-84fb-4dc176f901a3","Type":"ContainerDied","Data":"6237e3736089176765a79d4b9707734690b645e853abe06f13d71503dce7a177"}
Jul 29 06:27:31.841112 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.840916    2578 scope.go:117] "RemoveContainer" containerID="3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7"
Jul 29 06:27:31.849332 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.849316    2578 scope.go:117] "RemoveContainer" containerID="3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7"
Jul 29 06:27:31.849617 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:31.849596    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7\": container with ID starting with 3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7 not found: ID does not exist" containerID="3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7"
Jul 29 06:27:31.849656 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.849626    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7"} err="failed to get container status \"3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7\": rpc error: code = NotFound desc = could not find container \"3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7\": container with ID starting with 3f19670ef291266d25995ca3b719e8e5f738b842a9d317774c972e9ef316c2e7 not found: ID does not exist"
Jul 29 06:27:31.860795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.860769    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d47f847b-9vpnz"]
Jul 29 06:27:31.863834 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:31.863812    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64d47f847b-9vpnz"]
Jul 29 06:27:32.898634 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:32.898599    2578 scope.go:117] "RemoveContainer" containerID="1426ef503879a9176e5e070355a8bb7c317c76aee7ea1af3351d121e95ef7053"
Jul 29 06:27:32.903307 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:32.903283    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" path="/var/lib/kubelet/pods/c36af936-5be7-4329-84fb-4dc176f901a3/volumes"
Jul 29 06:27:33.704677 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.704636    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-qkct9"]
Jul 29 06:27:33.705032 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.705013    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" containerName="registry"
Jul 29 06:27:33.705120 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.705035    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" containerName="registry"
Jul 29 06:27:33.705120 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.705111    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c36af936-5be7-4329-84fb-4dc176f901a3" containerName="registry"
Jul 29 06:27:33.708186 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.708166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:33.710792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.710774    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-79gzw\""
Jul 29 06:27:33.711020 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.711004    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 06:27:33.711127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.711025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 06:27:33.716262 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.716242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-qkct9"]
Jul 29 06:27:33.795781 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.795741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt52h\" (UniqueName: \"kubernetes.io/projected/78585927-f55f-4a45-a243-d6372b3c62ac-kube-api-access-tt52h\") pod \"downloads-7c97dc4555-qkct9\" (UID: \"78585927-f55f-4a45-a243-d6372b3c62ac\") " pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:33.851563 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.851537    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:27:33.851740 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.851634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" event={"ID":"ac690d0e-c824-4b8b-9f44-f4f69a1eef7f","Type":"ContainerStarted","Data":"7e5aa85a32a5f1f535fb750bd5adde5bb1ca1313aaad8b68e9f393d42eaef4af"}
Jul 29 06:27:33.851933 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.851913    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:27:33.856818 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.856791    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm"
Jul 29 06:27:33.868498 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.868453    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-d8mbm" podStartSLOduration=53.139509348 podStartE2EDuration="55.868435618s" totalImagesPullingTime="2.72892627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:33.867547566 +0000 UTC m=+295.503139393" watchObservedRunningTime="2026-07-29 06:27:33.868435618 +0000 UTC m=+295.504027408"
Jul 29 06:27:33.897029 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.896985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt52h\" (UniqueName: \"kubernetes.io/projected/78585927-f55f-4a45-a243-d6372b3c62ac-kube-api-access-tt52h\") pod \"downloads-7c97dc4555-qkct9\" (UID: \"78585927-f55f-4a45-a243-d6372b3c62ac\") " pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:33.906432 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:33.906402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt52h\" (UniqueName: \"kubernetes.io/projected/78585927-f55f-4a45-a243-d6372b3c62ac-kube-api-access-tt52h\") pod \"downloads-7c97dc4555-qkct9\" (UID: \"78585927-f55f-4a45-a243-d6372b3c62ac\") " pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:34.017893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:34.017790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:34.148863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:34.148833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-qkct9"]
Jul 29 06:27:34.152117 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:34.152089    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78585927_f55f_4a45_a243_d6372b3c62ac.slice/crio-cc18dfe328669d10b7e4e8874d2633f1accf981132ee05227b10b8461e94d51b WatchSource:0}: Error finding container cc18dfe328669d10b7e4e8874d2633f1accf981132ee05227b10b8461e94d51b: Status 404 returned error can't find the container with id cc18dfe328669d10b7e4e8874d2633f1accf981132ee05227b10b8461e94d51b
Jul 29 06:27:34.858943 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:34.858908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-qkct9" event={"ID":"78585927-f55f-4a45-a243-d6372b3c62ac","Type":"ContainerStarted","Data":"cc18dfe328669d10b7e4e8874d2633f1accf981132ee05227b10b8461e94d51b"}
Jul 29 06:27:35.843761 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:35.843730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7889c996bb-xnblk"
Jul 29 06:27:35.899292 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:27:35.899251    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h4557" podUID="9951ac15-e995-42ad-9e96-669a8d362e11"
Jul 29 06:27:38.767068 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:38.766972    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:27:38.767402 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:38.767363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:27:38.773470 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:38.773446    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:27:38.774380 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:38.774364    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:27:38.779872 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:38.779853    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 06:27:38.836150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:38.836009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5rxmn"
Jul 29 06:27:43.812027 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.811988    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c6fccc98-rtpjj"]
Jul 29 06:27:43.818056 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.818024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.821567 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.821540    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 06:27:43.821736 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.821577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 06:27:43.821736 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.821625    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 06:27:43.821867 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.821778    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 06:27:43.821867 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.821815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gpzq6\""
Jul 29 06:27:43.821867 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.821841    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 06:27:43.825142 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.825120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c6fccc98-rtpjj"]
Jul 29 06:27:43.886001 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.885970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-service-ca\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.886001 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.886010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frnmc\" (UniqueName: \"kubernetes.io/projected/c094653a-ecb7-4416-9f29-f53b0f36fb83-kube-api-access-frnmc\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.886230 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.886039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-oauth-config\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.886230 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.886189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-serving-cert\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.886320 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.886242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-config\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.886320 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.886269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-oauth-serving-cert\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.987568 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.987530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-serving-cert\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.987568 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.987573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-config\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.987834 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.987701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-oauth-serving-cert\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.987908 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.987861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-service-ca\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.987965 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.987927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frnmc\" (UniqueName: \"kubernetes.io/projected/c094653a-ecb7-4416-9f29-f53b0f36fb83-kube-api-access-frnmc\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.988019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.987955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-oauth-config\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.988589 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.988348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-config\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.988589 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.988431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-oauth-serving-cert\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.988589 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.988546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-service-ca\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.990656 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.990614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-oauth-config\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.991137 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.991111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-serving-cert\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:43.996566 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:43.996543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frnmc\" (UniqueName: \"kubernetes.io/projected/c094653a-ecb7-4416-9f29-f53b0f36fb83-kube-api-access-frnmc\") pod \"console-66c6fccc98-rtpjj\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") " pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:44.130019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:44.129975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:27:44.289030 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:44.289004    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c6fccc98-rtpjj"]
Jul 29 06:27:44.291109 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:44.291072    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc094653a_ecb7_4416_9f29_f53b0f36fb83.slice/crio-cdf0e8324a045a860aa43c23fa19240fb7ea792d2543f2e08359e52330bccd4c WatchSource:0}: Error finding container cdf0e8324a045a860aa43c23fa19240fb7ea792d2543f2e08359e52330bccd4c: Status 404 returned error can't find the container with id cdf0e8324a045a860aa43c23fa19240fb7ea792d2543f2e08359e52330bccd4c
Jul 29 06:27:44.294063 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:44.294046    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 06:27:44.905161 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:44.905121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c6fccc98-rtpjj" event={"ID":"c094653a-ecb7-4416-9f29-f53b0f36fb83","Type":"ContainerStarted","Data":"cdf0e8324a045a860aa43c23fa19240fb7ea792d2543f2e08359e52330bccd4c"}
Jul 29 06:27:46.205901 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.205859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-575f6f784-qq4qk"]
Jul 29 06:27:46.311485 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.311439    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575f6f784-qq4qk"]
Jul 29 06:27:46.311674 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.311566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.335859 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.335816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 06:27:46.409167 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfvw\" (UniqueName: \"kubernetes.io/projected/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-kube-api-access-gdfvw\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.409167 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-trusted-ca-bundle\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.409412 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-service-ca\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.409412 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-oauth-config\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.409497 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-serving-cert\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.409497 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-config\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.409497 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.409492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-oauth-serving-cert\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.510830 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-serving-cert\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.510830 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-config\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511061 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-oauth-serving-cert\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511061 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfvw\" (UniqueName: \"kubernetes.io/projected/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-kube-api-access-gdfvw\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511061 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-trusted-ca-bundle\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511061 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-service-ca\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511061 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.510995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-oauth-config\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511987 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.511929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-service-ca\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.511987 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.511950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-trusted-ca-bundle\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.512150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.511986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-oauth-serving-cert\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.512150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.512120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-config\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.513835 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.513808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-serving-cert\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.513957 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.513893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-oauth-config\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.519317 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.519289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdfvw\" (UniqueName: \"kubernetes.io/projected/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-kube-api-access-gdfvw\") pod \"console-575f6f784-qq4qk\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") " pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:46.625492 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:46.625458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:27:48.904587 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:48.904557    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:27:51.836528 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:51.836496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575f6f784-qq4qk"]
Jul 29 06:27:51.929007 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:51.928973    2578 generic.go:356] "Generic (PLEG): container finished" podID="22bfb0fa-29e7-4903-af08-feb60505151a" containerID="ffa7e10de4062339f8a7b7915ba0f1952a4e5a7d5137a51c5f364207d6ed591f" exitCode=0
Jul 29 06:27:51.929007 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:51.929001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf" event={"ID":"22bfb0fa-29e7-4903-af08-feb60505151a","Type":"ContainerDied","Data":"ffa7e10de4062339f8a7b7915ba0f1952a4e5a7d5137a51c5f364207d6ed591f"}
Jul 29 06:27:51.929341 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:51.929327    2578 scope.go:117] "RemoveContainer" containerID="ffa7e10de4062339f8a7b7915ba0f1952a4e5a7d5137a51c5f364207d6ed591f"
Jul 29 06:27:51.987944 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:27:51.987872    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa0aa4b_0f12_47f1_939a_92dcaed1b8d4.slice/crio-5ba7bc029d8a32b1a45dfdb8386a31012ea0164a2f814ae23a5ea64f7ed4f45b WatchSource:0}: Error finding container 5ba7bc029d8a32b1a45dfdb8386a31012ea0164a2f814ae23a5ea64f7ed4f45b: Status 404 returned error can't find the container with id 5ba7bc029d8a32b1a45dfdb8386a31012ea0164a2f814ae23a5ea64f7ed4f45b
Jul 29 06:27:52.936056 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:52.936017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-qkct9" event={"ID":"78585927-f55f-4a45-a243-d6372b3c62ac","Type":"ContainerStarted","Data":"4378af6db00577d789cfa280916653c63615306bc04de2f5ac3b80a9d03e443f"}
Jul 29 06:27:52.937345 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:52.937085    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:52.939339 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:52.939229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575f6f784-qq4qk" event={"ID":"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4","Type":"ContainerStarted","Data":"5ba7bc029d8a32b1a45dfdb8386a31012ea0164a2f814ae23a5ea64f7ed4f45b"}
Jul 29 06:27:52.942158 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:52.942024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vczdf" event={"ID":"22bfb0fa-29e7-4903-af08-feb60505151a","Type":"ContainerStarted","Data":"49534c86368deb291d81a7b9a37e6312ab352824e26fc648196d550e8c4d607a"}
Jul 29 06:27:52.950964 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:52.950902    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-qkct9"
Jul 29 06:27:52.955782 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:52.955024    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-qkct9" podStartSLOduration=1.848871191 podStartE2EDuration="19.955000847s" totalImagesPullingTime="18.106129656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:52.953396987 +0000 UTC m=+314.588988779" watchObservedRunningTime="2026-07-29 06:27:52.955000847 +0000 UTC m=+314.590592639"
Jul 29 06:27:56.965842 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:56.965795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c6fccc98-rtpjj" event={"ID":"c094653a-ecb7-4416-9f29-f53b0f36fb83","Type":"ContainerStarted","Data":"25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7"}
Jul 29 06:27:56.967914 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:56.967881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575f6f784-qq4qk" event={"ID":"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4","Type":"ContainerStarted","Data":"20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30"}
Jul 29 06:27:56.983202 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:56.983143    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c6fccc98-rtpjj" podStartSLOduration=2.441169607 podStartE2EDuration="13.983121281s" totalImagesPullingTime="11.541951674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:56.981781435 +0000 UTC m=+318.617373230" watchObservedRunningTime="2026-07-29 06:27:56.983121281 +0000 UTC m=+318.618713084"
Jul 29 06:27:56.998128 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:27:56.998066    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-575f6f784-qq4qk" podStartSLOduration=7.03034403 podStartE2EDuration="10.998045579s" totalImagesPullingTime="3.967701549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:27:56.997350681 +0000 UTC m=+318.632942496" watchObservedRunningTime="2026-07-29 06:27:56.998045579 +0000 UTC m=+318.633637370"
Jul 29 06:28:04.131051 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:04.131005    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:28:04.131519 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:04.131079    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:28:04.135977 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:04.135950    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:28:05.005487 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:05.005457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:28:06.626005 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:06.625961    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:28:06.626432 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:06.626063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:28:06.630967 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:06.630941    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:28:07.015098 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:07.015015    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:28:07.058115 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:07.058072    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c6fccc98-rtpjj"]
Jul 29 06:28:13.079977 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:13.079938    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cf88d7cdf-w5kz2_ecc4b76d-788a-4a4a-87cd-4dacab9c514f/router/0.log"
Jul 29 06:28:13.095042 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:13.095013    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9nk9_44d59680-97e5-4bb5-afbb-e8f05a4806fa/serve-healthcheck-canary/0.log"
Jul 29 06:28:32.082068 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.081986    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c6fccc98-rtpjj" podUID="c094653a-ecb7-4416-9f29-f53b0f36fb83" containerName="console" containerID="cri-o://25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7" gracePeriod=15
Jul 29 06:28:32.367342 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.367310    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:28:32.531481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.531446    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-serving-cert\") pod \"c094653a-ecb7-4416-9f29-f53b0f36fb83\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") "
Jul 29 06:28:32.531657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.531504    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-oauth-serving-cert\") pod \"c094653a-ecb7-4416-9f29-f53b0f36fb83\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") "
Jul 29 06:28:32.531657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.531558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-config\") pod \"c094653a-ecb7-4416-9f29-f53b0f36fb83\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") "
Jul 29 06:28:32.531657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.531585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frnmc\" (UniqueName: \"kubernetes.io/projected/c094653a-ecb7-4416-9f29-f53b0f36fb83-kube-api-access-frnmc\") pod \"c094653a-ecb7-4416-9f29-f53b0f36fb83\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") "
Jul 29 06:28:32.531657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.531614    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-service-ca\") pod \"c094653a-ecb7-4416-9f29-f53b0f36fb83\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") "
Jul 29 06:28:32.531657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.531644    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-oauth-config\") pod \"c094653a-ecb7-4416-9f29-f53b0f36fb83\" (UID: \"c094653a-ecb7-4416-9f29-f53b0f36fb83\") "
Jul 29 06:28:32.532271 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.532056    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c094653a-ecb7-4416-9f29-f53b0f36fb83" (UID: "c094653a-ecb7-4416-9f29-f53b0f36fb83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:28:32.532271 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.532071    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-service-ca" (OuterVolumeSpecName: "service-ca") pod "c094653a-ecb7-4416-9f29-f53b0f36fb83" (UID: "c094653a-ecb7-4416-9f29-f53b0f36fb83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:28:32.532271 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.532057    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-config" (OuterVolumeSpecName: "console-config") pod "c094653a-ecb7-4416-9f29-f53b0f36fb83" (UID: "c094653a-ecb7-4416-9f29-f53b0f36fb83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:28:32.534042 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.534012    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c094653a-ecb7-4416-9f29-f53b0f36fb83" (UID: "c094653a-ecb7-4416-9f29-f53b0f36fb83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:28:32.534143 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.534044    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c094653a-ecb7-4416-9f29-f53b0f36fb83-kube-api-access-frnmc" (OuterVolumeSpecName: "kube-api-access-frnmc") pod "c094653a-ecb7-4416-9f29-f53b0f36fb83" (UID: "c094653a-ecb7-4416-9f29-f53b0f36fb83"). InnerVolumeSpecName "kube-api-access-frnmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:28:32.534143 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.534084    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c094653a-ecb7-4416-9f29-f53b0f36fb83" (UID: "c094653a-ecb7-4416-9f29-f53b0f36fb83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:28:32.632303 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.632264    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:28:32.632303 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.632295    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-oauth-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:28:32.632303 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.632305    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:28:32.632527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.632314    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frnmc\" (UniqueName: \"kubernetes.io/projected/c094653a-ecb7-4416-9f29-f53b0f36fb83-kube-api-access-frnmc\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:28:32.632527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.632323    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c094653a-ecb7-4416-9f29-f53b0f36fb83-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:28:32.632527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:32.632330    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c094653a-ecb7-4416-9f29-f53b0f36fb83-console-oauth-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:28:33.115125 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.115086    2578 generic.go:356] "Generic (PLEG): container finished" podID="c094653a-ecb7-4416-9f29-f53b0f36fb83" containerID="25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7" exitCode=0
Jul 29 06:28:33.115502 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.115151    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c6fccc98-rtpjj"
Jul 29 06:28:33.115502 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.115197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c6fccc98-rtpjj" event={"ID":"c094653a-ecb7-4416-9f29-f53b0f36fb83","Type":"ContainerDied","Data":"25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7"}
Jul 29 06:28:33.115502 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.115252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c6fccc98-rtpjj" event={"ID":"c094653a-ecb7-4416-9f29-f53b0f36fb83","Type":"ContainerDied","Data":"cdf0e8324a045a860aa43c23fa19240fb7ea792d2543f2e08359e52330bccd4c"}
Jul 29 06:28:33.115502 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.115275    2578 scope.go:117] "RemoveContainer" containerID="25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7"
Jul 29 06:28:33.123784 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.123764    2578 scope.go:117] "RemoveContainer" containerID="25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7"
Jul 29 06:28:33.124116 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:28:33.124093    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7\": container with ID starting with 25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7 not found: ID does not exist" containerID="25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7"
Jul 29 06:28:33.124167 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.124127    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7"} err="failed to get container status \"25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7\": rpc error: code = NotFound desc = could not find container \"25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7\": container with ID starting with 25436c951c79de24ed6fa26848cd00f0ec6834bb92fe80124262700ea6da87f7 not found: ID does not exist"
Jul 29 06:28:33.129284 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.129260    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c6fccc98-rtpjj"]
Jul 29 06:28:33.132886 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:33.132864    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c6fccc98-rtpjj"]
Jul 29 06:28:34.907622 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:34.907589    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c094653a-ecb7-4416-9f29-f53b0f36fb83" path="/var/lib/kubelet/pods/c094653a-ecb7-4416-9f29-f53b0f36fb83/volumes"
Jul 29 06:28:51.143293 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.143253    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-796fbbd4-mqk92"]
Jul 29 06:28:51.143703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.143577    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c094653a-ecb7-4416-9f29-f53b0f36fb83" containerName="console"
Jul 29 06:28:51.143703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.143591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c094653a-ecb7-4416-9f29-f53b0f36fb83" containerName="console"
Jul 29 06:28:51.143703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.143643    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c094653a-ecb7-4416-9f29-f53b0f36fb83" containerName="console"
Jul 29 06:28:51.146641 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.146615    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.158263 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.158239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796fbbd4-mqk92"]
Jul 29 06:28:51.178277 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-console-config\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.178430 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-serving-cert\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.178430 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rpv\" (UniqueName: \"kubernetes.io/projected/b4391cae-6dac-4c52-939a-818df5eb6e21-kube-api-access-22rpv\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.178430 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-service-ca\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.178430 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-trusted-ca-bundle\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.178579 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-oauth-config\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.178579 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.178533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-oauth-serving-cert\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.278910 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.278877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-oauth-config\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.278910 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.278917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-oauth-serving-cert\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279121 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-console-config\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279121 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-serving-cert\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279121 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rpv\" (UniqueName: \"kubernetes.io/projected/b4391cae-6dac-4c52-939a-818df5eb6e21-kube-api-access-22rpv\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279274 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-service-ca\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279330 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-trusted-ca-bundle\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279644 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-oauth-serving-cert\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279878 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-service-ca\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.279926 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.279898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-console-config\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.280114 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.280097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-trusted-ca-bundle\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.281530 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.281510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-oauth-config\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.281650 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.281632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-serving-cert\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.288173 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.288156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rpv\" (UniqueName: \"kubernetes.io/projected/b4391cae-6dac-4c52-939a-818df5eb6e21-kube-api-access-22rpv\") pod \"console-796fbbd4-mqk92\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") " pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.457178 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.457094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:28:51.590737 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:51.590696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796fbbd4-mqk92"]
Jul 29 06:28:51.593353 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:28:51.593326    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4391cae_6dac_4c52_939a_818df5eb6e21.slice/crio-4dea878a4bfb13e83f8a5e91d18a24319f472b57dafbccfb9736160377311032 WatchSource:0}: Error finding container 4dea878a4bfb13e83f8a5e91d18a24319f472b57dafbccfb9736160377311032: Status 404 returned error can't find the container with id 4dea878a4bfb13e83f8a5e91d18a24319f472b57dafbccfb9736160377311032
Jul 29 06:28:52.187693 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.187657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796fbbd4-mqk92" event={"ID":"b4391cae-6dac-4c52-939a-818df5eb6e21","Type":"ContainerStarted","Data":"8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb"}
Jul 29 06:28:52.188081 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.187728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796fbbd4-mqk92" event={"ID":"b4391cae-6dac-4c52-939a-818df5eb6e21","Type":"ContainerStarted","Data":"4dea878a4bfb13e83f8a5e91d18a24319f472b57dafbccfb9736160377311032"}
Jul 29 06:28:52.202786 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.202704    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-796fbbd4-mqk92" podStartSLOduration=1.202686914 podStartE2EDuration="1.202686914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:28:52.202533384 +0000 UTC m=+373.838125280" watchObservedRunningTime="2026-07-29 06:28:52.202686914 +0000 UTC m=+373.838278706"
Jul 29 06:28:52.790432 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.790387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:28:52.792887 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.792869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9951ac15-e995-42ad-9e96-669a8d362e11-metrics-certs\") pod \"network-metrics-daemon-h4557\" (UID: \"9951ac15-e995-42ad-9e96-669a8d362e11\") " pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:28:52.807946 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.807920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-btmpr\""
Jul 29 06:28:52.816838 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.816820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4557"
Jul 29 06:28:52.946550 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:52.946527    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h4557"]
Jul 29 06:28:52.949033 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:28:52.949004    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9951ac15_e995_42ad_9e96_669a8d362e11.slice/crio-7373143d4d9a9af5a7564853fefbe2496c1a62b59a7dbfb65024dba2f6b1135c WatchSource:0}: Error finding container 7373143d4d9a9af5a7564853fefbe2496c1a62b59a7dbfb65024dba2f6b1135c: Status 404 returned error can't find the container with id 7373143d4d9a9af5a7564853fefbe2496c1a62b59a7dbfb65024dba2f6b1135c
Jul 29 06:28:53.192494 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:53.192459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h4557" event={"ID":"9951ac15-e995-42ad-9e96-669a8d362e11","Type":"ContainerStarted","Data":"7373143d4d9a9af5a7564853fefbe2496c1a62b59a7dbfb65024dba2f6b1135c"}
Jul 29 06:28:54.197797 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:54.197760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h4557" event={"ID":"9951ac15-e995-42ad-9e96-669a8d362e11","Type":"ContainerStarted","Data":"2bd16248d8351dfa5353721b4dd12e9888e335254c1f0135c463aadbcd167288"}
Jul 29 06:28:54.198266 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:54.197810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h4557" event={"ID":"9951ac15-e995-42ad-9e96-669a8d362e11","Type":"ContainerStarted","Data":"1a5aa85503223b3cd070d636d72072b2da945fa15965829eaa3e758fb06cdb10"}
Jul 29 06:28:54.211949 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:28:54.211900    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h4557" podStartSLOduration=374.39397169 podStartE2EDuration="6m15.211884496s" totalImagesPullingTime="817.912806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:28:54.211256552 +0000 UTC m=+375.846848367" watchObservedRunningTime="2026-07-29 06:28:54.211884496 +0000 UTC m=+375.847476287"
Jul 29 06:29:01.457830 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:01.457793    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:29:01.458213 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:01.457859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:29:01.462372 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:01.462351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:29:02.230394 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:02.230366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:29:02.270945 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:02.270916    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575f6f784-qq4qk"]
Jul 29 06:29:27.293595 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.293529    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-575f6f784-qq4qk" podUID="5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" containerName="console" containerID="cri-o://20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30" gracePeriod=15
Jul 29 06:29:27.535918 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.535893    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:29:27.670966 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.670927    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-config\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.670966 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.670967    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-oauth-config\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.671216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671010    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-trusted-ca-bundle\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.671216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-serving-cert\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.671216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671068    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-service-ca\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.671216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdfvw\" (UniqueName: \"kubernetes.io/projected/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-kube-api-access-gdfvw\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.671216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-oauth-serving-cert\") pod \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\" (UID: \"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4\") "
Jul 29 06:29:27.671452 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-config" (OuterVolumeSpecName: "console-config") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:29:27.671582 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671504    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:29:27.671697 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671671    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:29:27.671826 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.671742    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-service-ca" (OuterVolumeSpecName: "service-ca") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:29:27.673475 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.673451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:29:27.673577 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.673474    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:29:27.673577 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.673484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-kube-api-access-gdfvw" (OuterVolumeSpecName: "kube-api-access-gdfvw") pod "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" (UID: "5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4"). InnerVolumeSpecName "kube-api-access-gdfvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:29:27.772295 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772259    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:27.772295 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772288    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdfvw\" (UniqueName: \"kubernetes.io/projected/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-kube-api-access-gdfvw\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:27.772295 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772298    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-oauth-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:27.772295 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772306    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:27.772545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772315    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-oauth-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:27.772545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772323    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-trusted-ca-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:27.772545 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:27.772331    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4-console-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:29:28.325021 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.324984    2578 generic.go:356] "Generic (PLEG): container finished" podID="5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" containerID="20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30" exitCode=0
Jul 29 06:29:28.325536 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.325033    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575f6f784-qq4qk"
Jul 29 06:29:28.325536 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.325048    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575f6f784-qq4qk" event={"ID":"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4","Type":"ContainerDied","Data":"20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30"}
Jul 29 06:29:28.325536 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.325100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575f6f784-qq4qk" event={"ID":"5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4","Type":"ContainerDied","Data":"5ba7bc029d8a32b1a45dfdb8386a31012ea0164a2f814ae23a5ea64f7ed4f45b"}
Jul 29 06:29:28.325536 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.325129    2578 scope.go:117] "RemoveContainer" containerID="20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30"
Jul 29 06:29:28.333911 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.333893    2578 scope.go:117] "RemoveContainer" containerID="20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30"
Jul 29 06:29:28.334169 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:29:28.334149    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30\": container with ID starting with 20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30 not found: ID does not exist" containerID="20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30"
Jul 29 06:29:28.334213 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.334178    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30"} err="failed to get container status \"20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30\": rpc error: code = NotFound desc = could not find container \"20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30\": container with ID starting with 20564e6edd61fdf75f96b49332cf0cf761a0930a4598afe415276e18625bcd30 not found: ID does not exist"
Jul 29 06:29:28.344175 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.344148    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-575f6f784-qq4qk"]
Jul 29 06:29:28.347499 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.347477    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-575f6f784-qq4qk"]
Jul 29 06:29:28.906519 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:29:28.906487    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" path="/var/lib/kubelet/pods/5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4/volumes"
Jul 29 06:30:33.707507 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.707463    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66489b9d84-fl8fz"]
Jul 29 06:30:33.708025 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.707942    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" containerName="console"
Jul 29 06:30:33.708025 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.707958    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" containerName="console"
Jul 29 06:30:33.708025 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.708019    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa0aa4b-0f12-47f1-939a-92dcaed1b8d4" containerName="console"
Jul 29 06:30:33.709931 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.709912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.720397 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.720365    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66489b9d84-fl8fz"]
Jul 29 06:30:33.778252 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-trusted-ca-bundle\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.778252 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-config\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.778452 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-serving-cert\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.778452 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-oauth-config\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.778452 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-oauth-serving-cert\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.778452 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq45b\" (UniqueName: \"kubernetes.io/projected/14a23bc9-c4ff-4a09-9052-c454bf5924ba-kube-api-access-dq45b\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.778571 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.778460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-service-ca\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879449 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-service-ca\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879449 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-trusted-ca-bundle\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-config\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-serving-cert\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-oauth-config\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879703 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-oauth-serving-cert\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.879949 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.879780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq45b\" (UniqueName: \"kubernetes.io/projected/14a23bc9-c4ff-4a09-9052-c454bf5924ba-kube-api-access-dq45b\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.880522 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.880486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-service-ca\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.880678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.880641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-config\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.880952 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.880927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-oauth-serving-cert\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.881266 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.881240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-trusted-ca-bundle\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.886922 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.886872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-oauth-config\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.887268 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.887248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-serving-cert\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:33.888639 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:33.888622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq45b\" (UniqueName: \"kubernetes.io/projected/14a23bc9-c4ff-4a09-9052-c454bf5924ba-kube-api-access-dq45b\") pod \"console-66489b9d84-fl8fz\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") " pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:34.018838 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:34.018757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:34.149355 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:34.149259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66489b9d84-fl8fz"]
Jul 29 06:30:34.152097 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:30:34.152057    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a23bc9_c4ff_4a09_9052_c454bf5924ba.slice/crio-b8844938a67b20589d427c0ccf095ef43763c579b7cf90dacdae2be6dde0819b WatchSource:0}: Error finding container b8844938a67b20589d427c0ccf095ef43763c579b7cf90dacdae2be6dde0819b: Status 404 returned error can't find the container with id b8844938a67b20589d427c0ccf095ef43763c579b7cf90dacdae2be6dde0819b
Jul 29 06:30:34.562912 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:34.562875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66489b9d84-fl8fz" event={"ID":"14a23bc9-c4ff-4a09-9052-c454bf5924ba","Type":"ContainerStarted","Data":"d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00"}
Jul 29 06:30:34.563086 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:34.562935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66489b9d84-fl8fz" event={"ID":"14a23bc9-c4ff-4a09-9052-c454bf5924ba","Type":"ContainerStarted","Data":"b8844938a67b20589d427c0ccf095ef43763c579b7cf90dacdae2be6dde0819b"}
Jul 29 06:30:34.579107 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:34.579060    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66489b9d84-fl8fz" podStartSLOduration=1.5790439699999999 podStartE2EDuration="1.57904397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:30:34.577832329 +0000 UTC m=+476.213424121" watchObservedRunningTime="2026-07-29 06:30:34.57904397 +0000 UTC m=+476.214635760"
Jul 29 06:30:44.018896 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:44.018854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:44.019382 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:44.018915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:44.023499 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:44.023480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:44.603501 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:44.603468    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:30:44.645732 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:30:44.645677    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-796fbbd4-mqk92"]
Jul 29 06:31:09.670765 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:09.670701    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-796fbbd4-mqk92" podUID="b4391cae-6dac-4c52-939a-818df5eb6e21" containerName="console" containerID="cri-o://8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb" gracePeriod=15
Jul 29 06:31:09.911991 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:09.911966    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:31:10.071103 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071010    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-oauth-config\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071103 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071059    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22rpv\" (UniqueName: \"kubernetes.io/projected/b4391cae-6dac-4c52-939a-818df5eb6e21-kube-api-access-22rpv\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071103 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-service-ca\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071103 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-console-config\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071415 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071121    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-trusted-ca-bundle\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071415 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-serving-cert\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071415 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071188    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-oauth-serving-cert\") pod \"b4391cae-6dac-4c52-939a-818df5eb6e21\" (UID: \"b4391cae-6dac-4c52-939a-818df5eb6e21\") "
Jul 29 06:31:10.071560 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071539    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:31:10.071606 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071580    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-console-config" (OuterVolumeSpecName: "console-config") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:31:10.071675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071656    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:31:10.071758 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.071682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:31:10.073443 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.073407    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:31:10.073548 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.073464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4391cae-6dac-4c52-939a-818df5eb6e21-kube-api-access-22rpv" (OuterVolumeSpecName: "kube-api-access-22rpv") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "kube-api-access-22rpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:31:10.073548 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.073496    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4391cae-6dac-4c52-939a-818df5eb6e21" (UID: "b4391cae-6dac-4c52-939a-818df5eb6e21"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:31:10.172336 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172300    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22rpv\" (UniqueName: \"kubernetes.io/projected/b4391cae-6dac-4c52-939a-818df5eb6e21-kube-api-access-22rpv\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.172336 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172330    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.172336 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172339    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-console-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.172553 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172348    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-trusted-ca-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.172553 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172356    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.172553 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172364    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4391cae-6dac-4c52-939a-818df5eb6e21-oauth-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.172553 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.172374    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4391cae-6dac-4c52-939a-818df5eb6e21-console-oauth-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:10.702868 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.702825    2578 generic.go:356] "Generic (PLEG): container finished" podID="b4391cae-6dac-4c52-939a-818df5eb6e21" containerID="8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb" exitCode=0
Jul 29 06:31:10.703218 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.702876    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796fbbd4-mqk92"
Jul 29 06:31:10.703218 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.702912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796fbbd4-mqk92" event={"ID":"b4391cae-6dac-4c52-939a-818df5eb6e21","Type":"ContainerDied","Data":"8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb"}
Jul 29 06:31:10.703218 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.702966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796fbbd4-mqk92" event={"ID":"b4391cae-6dac-4c52-939a-818df5eb6e21","Type":"ContainerDied","Data":"4dea878a4bfb13e83f8a5e91d18a24319f472b57dafbccfb9736160377311032"}
Jul 29 06:31:10.703218 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.702987    2578 scope.go:117] "RemoveContainer" containerID="8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb"
Jul 29 06:31:10.711814 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.711797    2578 scope.go:117] "RemoveContainer" containerID="8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb"
Jul 29 06:31:10.712102 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:31:10.712081    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb\": container with ID starting with 8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb not found: ID does not exist" containerID="8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb"
Jul 29 06:31:10.712147 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.712110    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb"} err="failed to get container status \"8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb\": rpc error: code = NotFound desc = could not find container \"8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb\": container with ID starting with 8d9a5061b52b409698117cd6d94aa47be24827eedcc6881b470e2a3d750ce7fb not found: ID does not exist"
Jul 29 06:31:10.723142 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.723116    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-796fbbd4-mqk92"]
Jul 29 06:31:10.728536 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.728517    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-796fbbd4-mqk92"]
Jul 29 06:31:10.903419 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:10.903386    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4391cae-6dac-4c52-939a-818df5eb6e21" path="/var/lib/kubelet/pods/b4391cae-6dac-4c52-939a-818df5eb6e21/volumes"
Jul 29 06:31:14.659621 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.659585    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"]
Jul 29 06:31:14.660031 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.659878    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4391cae-6dac-4c52-939a-818df5eb6e21" containerName="console"
Jul 29 06:31:14.660031 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.659889    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4391cae-6dac-4c52-939a-818df5eb6e21" containerName="console"
Jul 29 06:31:14.660031 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.659956    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4391cae-6dac-4c52-939a-818df5eb6e21" containerName="console"
Jul 29 06:31:14.664350 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.664335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.666927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.666904    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 06:31:14.667048 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.666902    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 06:31:14.667048 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.666906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m9mnn\""
Jul 29 06:31:14.671122 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.671090    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"]
Jul 29 06:31:14.705003 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.704974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dwtw\" (UniqueName: \"kubernetes.io/projected/0af19028-508a-4d9d-93d1-092addc9d533-kube-api-access-8dwtw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.705179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.705047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.705179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.705070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.806211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.806175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.806211 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.806212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.806406 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.806236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dwtw\" (UniqueName: \"kubernetes.io/projected/0af19028-508a-4d9d-93d1-092addc9d533-kube-api-access-8dwtw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.806595 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.806572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.806630 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.806579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.813997 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.813973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dwtw\" (UniqueName: \"kubernetes.io/projected/0af19028-508a-4d9d-93d1-092addc9d533-kube-api-access-8dwtw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:14.974724 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:14.974631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:15.108471 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:15.108435    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"]
Jul 29 06:31:15.111528 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:31:15.111501    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af19028_508a_4d9d_93d1_092addc9d533.slice/crio-aed0abba621d4e7aec396770451a592385cb24b1208df79125daaf6e49ca6d57 WatchSource:0}: Error finding container aed0abba621d4e7aec396770451a592385cb24b1208df79125daaf6e49ca6d57: Status 404 returned error can't find the container with id aed0abba621d4e7aec396770451a592385cb24b1208df79125daaf6e49ca6d57
Jul 29 06:31:15.723170 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:15.723137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6" event={"ID":"0af19028-508a-4d9d-93d1-092addc9d533","Type":"ContainerStarted","Data":"aed0abba621d4e7aec396770451a592385cb24b1208df79125daaf6e49ca6d57"}
Jul 29 06:31:21.750925 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:21.750892    2578 generic.go:356] "Generic (PLEG): container finished" podID="0af19028-508a-4d9d-93d1-092addc9d533" containerID="57672ac8e271a9418c1999caf7f693b6c316232d337fd6d657731b9c5405b4c5" exitCode=0
Jul 29 06:31:21.751295 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:21.750950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6" event={"ID":"0af19028-508a-4d9d-93d1-092addc9d533","Type":"ContainerDied","Data":"57672ac8e271a9418c1999caf7f693b6c316232d337fd6d657731b9c5405b4c5"}
Jul 29 06:31:24.765418 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:24.765376    2578 generic.go:356] "Generic (PLEG): container finished" podID="0af19028-508a-4d9d-93d1-092addc9d533" containerID="cfe3c0d8607e98748135aadd95f2396700bbb3272145cc9af204f8d768d92feb" exitCode=0
Jul 29 06:31:24.765898 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:24.765451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6" event={"ID":"0af19028-508a-4d9d-93d1-092addc9d533","Type":"ContainerDied","Data":"cfe3c0d8607e98748135aadd95f2396700bbb3272145cc9af204f8d768d92feb"}
Jul 29 06:31:32.802169 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:32.802132    2578 generic.go:356] "Generic (PLEG): container finished" podID="0af19028-508a-4d9d-93d1-092addc9d533" containerID="cc13c5d613c09ed40ce1c908070ae2ebdac07d65456d73a52ad2e6a158d1d547" exitCode=0
Jul 29 06:31:32.802554 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:32.802224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6" event={"ID":"0af19028-508a-4d9d-93d1-092addc9d533","Type":"ContainerDied","Data":"cc13c5d613c09ed40ce1c908070ae2ebdac07d65456d73a52ad2e6a158d1d547"}
Jul 29 06:31:33.939782 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:33.939756    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:34.058552 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.058457    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-util\") pod \"0af19028-508a-4d9d-93d1-092addc9d533\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") "
Jul 29 06:31:34.058552 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.058544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-bundle\") pod \"0af19028-508a-4d9d-93d1-092addc9d533\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") "
Jul 29 06:31:34.058813 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.058592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dwtw\" (UniqueName: \"kubernetes.io/projected/0af19028-508a-4d9d-93d1-092addc9d533-kube-api-access-8dwtw\") pod \"0af19028-508a-4d9d-93d1-092addc9d533\" (UID: \"0af19028-508a-4d9d-93d1-092addc9d533\") "
Jul 29 06:31:34.059222 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.059192    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-bundle" (OuterVolumeSpecName: "bundle") pod "0af19028-508a-4d9d-93d1-092addc9d533" (UID: "0af19028-508a-4d9d-93d1-092addc9d533"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:31:34.061071 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.061039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af19028-508a-4d9d-93d1-092addc9d533-kube-api-access-8dwtw" (OuterVolumeSpecName: "kube-api-access-8dwtw") pod "0af19028-508a-4d9d-93d1-092addc9d533" (UID: "0af19028-508a-4d9d-93d1-092addc9d533"). InnerVolumeSpecName "kube-api-access-8dwtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:31:34.062680 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.062656    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-util" (OuterVolumeSpecName: "util") pod "0af19028-508a-4d9d-93d1-092addc9d533" (UID: "0af19028-508a-4d9d-93d1-092addc9d533"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:31:34.159577 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.159548    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:34.159577 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.159573    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dwtw\" (UniqueName: \"kubernetes.io/projected/0af19028-508a-4d9d-93d1-092addc9d533-kube-api-access-8dwtw\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:34.159577 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.159583    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af19028-508a-4d9d-93d1-092addc9d533-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:34.812496 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.812464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6" event={"ID":"0af19028-508a-4d9d-93d1-092addc9d533","Type":"ContainerDied","Data":"aed0abba621d4e7aec396770451a592385cb24b1208df79125daaf6e49ca6d57"}
Jul 29 06:31:34.812686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.812508    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aed0abba621d4e7aec396770451a592385cb24b1208df79125daaf6e49ca6d57"
Jul 29 06:31:34.812686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:34.812524    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z49j6"
Jul 29 06:31:42.399451 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399417    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"]
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399684    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="util"
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399693    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="util"
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399703    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="extract"
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399726    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="extract"
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399761    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="pull"
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399770    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="pull"
Jul 29 06:31:42.399893 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.399830    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af19028-508a-4d9d-93d1-092addc9d533" containerName="extract"
Jul 29 06:31:42.408910 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.408887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.411321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.411291    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:31:42.411540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.411525    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 06:31:42.411605 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.411589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wbzlr\""
Jul 29 06:31:42.420395 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.420369    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"]
Jul 29 06:31:42.519585 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.519545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcwxq\" (UniqueName: \"kubernetes.io/projected/33bd0ccf-0459-4cbc-8159-54a58ec45663-kube-api-access-tcwxq\") pod \"cert-manager-operator-controller-manager-55c444bf86-cxmsd\" (UID: \"33bd0ccf-0459-4cbc-8159-54a58ec45663\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.519585 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.519591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33bd0ccf-0459-4cbc-8159-54a58ec45663-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cxmsd\" (UID: \"33bd0ccf-0459-4cbc-8159-54a58ec45663\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.620920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.620887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33bd0ccf-0459-4cbc-8159-54a58ec45663-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cxmsd\" (UID: \"33bd0ccf-0459-4cbc-8159-54a58ec45663\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.621073 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.620966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcwxq\" (UniqueName: \"kubernetes.io/projected/33bd0ccf-0459-4cbc-8159-54a58ec45663-kube-api-access-tcwxq\") pod \"cert-manager-operator-controller-manager-55c444bf86-cxmsd\" (UID: \"33bd0ccf-0459-4cbc-8159-54a58ec45663\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.621257 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.621237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33bd0ccf-0459-4cbc-8159-54a58ec45663-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cxmsd\" (UID: \"33bd0ccf-0459-4cbc-8159-54a58ec45663\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.630854 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.630828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcwxq\" (UniqueName: \"kubernetes.io/projected/33bd0ccf-0459-4cbc-8159-54a58ec45663-kube-api-access-tcwxq\") pod \"cert-manager-operator-controller-manager-55c444bf86-cxmsd\" (UID: \"33bd0ccf-0459-4cbc-8159-54a58ec45663\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.718757 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.718650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"
Jul 29 06:31:42.852195 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:42.852167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd"]
Jul 29 06:31:42.855631 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:31:42.855606    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bd0ccf_0459_4cbc_8159_54a58ec45663.slice/crio-dc2b3d5b6e5087626aca74e613b93f457da81ce73e37282b78a8610a38ee5c20 WatchSource:0}: Error finding container dc2b3d5b6e5087626aca74e613b93f457da81ce73e37282b78a8610a38ee5c20: Status 404 returned error can't find the container with id dc2b3d5b6e5087626aca74e613b93f457da81ce73e37282b78a8610a38ee5c20
Jul 29 06:31:43.848639 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:43.848603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd" event={"ID":"33bd0ccf-0459-4cbc-8159-54a58ec45663","Type":"ContainerStarted","Data":"dc2b3d5b6e5087626aca74e613b93f457da81ce73e37282b78a8610a38ee5c20"}
Jul 29 06:31:44.855698 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:44.855660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd" event={"ID":"33bd0ccf-0459-4cbc-8159-54a58ec45663","Type":"ContainerStarted","Data":"7b6ad1018543604ccd776b42759ae531da458f1239ac46cbc9aa7d0746a90b8e"}
Jul 29 06:31:44.875311 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:44.875252    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cxmsd" podStartSLOduration=0.975858037 podStartE2EDuration="2.875229753s" totalImagesPullingTime="1.899371716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:31:44.874186284 +0000 UTC m=+546.509778082" watchObservedRunningTime="2026-07-29 06:31:44.875229753 +0000 UTC m=+546.510821550"
Jul 29 06:31:46.289262 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.289227    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"]
Jul 29 06:31:46.292691 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.292671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.294907 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.294884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m9mnn\""
Jul 29 06:31:46.295129 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.295115    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 06:31:46.295844 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.295826    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 06:31:46.300004 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.299983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"]
Jul 29 06:31:46.353673 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.353643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.353673 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.353679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.353911 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.353773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdjv\" (UniqueName: \"kubernetes.io/projected/151da502-c4cd-43b5-a9a7-8c048e4e19cd-kube-api-access-lpdjv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.455041 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.455003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.455041 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.455038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.455293 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.455065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdjv\" (UniqueName: \"kubernetes.io/projected/151da502-c4cd-43b5-a9a7-8c048e4e19cd-kube-api-access-lpdjv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.455400 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.455377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.455463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.455432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.467695 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.467670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdjv\" (UniqueName: \"kubernetes.io/projected/151da502-c4cd-43b5-a9a7-8c048e4e19cd-kube-api-access-lpdjv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.603259 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.603172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:46.735093 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.735059    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"]
Jul 29 06:31:46.738038 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:31:46.738005    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151da502_c4cd_43b5_a9a7_8c048e4e19cd.slice/crio-b680feb6739f2569d8bcbe83e5f11382add5bcfd079033b9739fe87b5c47c689 WatchSource:0}: Error finding container b680feb6739f2569d8bcbe83e5f11382add5bcfd079033b9739fe87b5c47c689: Status 404 returned error can't find the container with id b680feb6739f2569d8bcbe83e5f11382add5bcfd079033b9739fe87b5c47c689
Jul 29 06:31:46.867040 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.867002    2578 generic.go:356] "Generic (PLEG): container finished" podID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerID="ae7680b3e9ceb26afc535188230343aa02b62192c7d5bbe82f7faf0a33bcf4e8" exitCode=0
Jul 29 06:31:46.867164 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.867078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg" event={"ID":"151da502-c4cd-43b5-a9a7-8c048e4e19cd","Type":"ContainerDied","Data":"ae7680b3e9ceb26afc535188230343aa02b62192c7d5bbe82f7faf0a33bcf4e8"}
Jul 29 06:31:46.867164 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:46.867116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg" event={"ID":"151da502-c4cd-43b5-a9a7-8c048e4e19cd","Type":"ContainerStarted","Data":"b680feb6739f2569d8bcbe83e5f11382add5bcfd079033b9739fe87b5c47c689"}
Jul 29 06:31:48.878102 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:48.878065    2578 generic.go:356] "Generic (PLEG): container finished" podID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerID="21c791adde94f63d8abe008e54d3c529feee717da216aa5cd1b731968aa71a64" exitCode=0
Jul 29 06:31:48.878472 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:48.878114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg" event={"ID":"151da502-c4cd-43b5-a9a7-8c048e4e19cd","Type":"ContainerDied","Data":"21c791adde94f63d8abe008e54d3c529feee717da216aa5cd1b731968aa71a64"}
Jul 29 06:31:49.516361 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.516322    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2hv5r"]
Jul 29 06:31:49.519483 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.519460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.521742 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.521696    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 06:31:49.521853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.521769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r7bbg\""
Jul 29 06:31:49.521853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.521808    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 06:31:49.530516 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.530488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2hv5r"]
Jul 29 06:31:49.583183 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.583152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbhbq\" (UniqueName: \"kubernetes.io/projected/6ac58575-0808-41dc-9760-f08731a9ab2a-kube-api-access-fbhbq\") pod \"cert-manager-webhook-6486ffd997-2hv5r\" (UID: \"6ac58575-0808-41dc-9760-f08731a9ab2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.583332 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.583256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ac58575-0808-41dc-9760-f08731a9ab2a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2hv5r\" (UID: \"6ac58575-0808-41dc-9760-f08731a9ab2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.683883 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.683842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbhbq\" (UniqueName: \"kubernetes.io/projected/6ac58575-0808-41dc-9760-f08731a9ab2a-kube-api-access-fbhbq\") pod \"cert-manager-webhook-6486ffd997-2hv5r\" (UID: \"6ac58575-0808-41dc-9760-f08731a9ab2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.684050 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.683933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ac58575-0808-41dc-9760-f08731a9ab2a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2hv5r\" (UID: \"6ac58575-0808-41dc-9760-f08731a9ab2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.691758 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.691726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ac58575-0808-41dc-9760-f08731a9ab2a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2hv5r\" (UID: \"6ac58575-0808-41dc-9760-f08731a9ab2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.691947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.691928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbhbq\" (UniqueName: \"kubernetes.io/projected/6ac58575-0808-41dc-9760-f08731a9ab2a-kube-api-access-fbhbq\") pod \"cert-manager-webhook-6486ffd997-2hv5r\" (UID: \"6ac58575-0808-41dc-9760-f08731a9ab2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.834864 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.834774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:49.887480 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.887447    2578 generic.go:356] "Generic (PLEG): container finished" podID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerID="549a43a0b28cab95afa99af6580f578f45e4822841b102581e3ac17f12509248" exitCode=0
Jul 29 06:31:49.887896 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.887561    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg" event={"ID":"151da502-c4cd-43b5-a9a7-8c048e4e19cd","Type":"ContainerDied","Data":"549a43a0b28cab95afa99af6580f578f45e4822841b102581e3ac17f12509248"}
Jul 29 06:31:49.966539 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:49.966509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2hv5r"]
Jul 29 06:31:49.968945 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:31:49.968911    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ac58575_0808_41dc_9760_f08731a9ab2a.slice/crio-2bc1679f8235b4743322c672183cbb62bebec5c51ff3e7cb6b662d1c0688715d WatchSource:0}: Error finding container 2bc1679f8235b4743322c672183cbb62bebec5c51ff3e7cb6b662d1c0688715d: Status 404 returned error can't find the container with id 2bc1679f8235b4743322c672183cbb62bebec5c51ff3e7cb6b662d1c0688715d
Jul 29 06:31:50.893838 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:50.893805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r" event={"ID":"6ac58575-0808-41dc-9760-f08731a9ab2a","Type":"ContainerStarted","Data":"2bc1679f8235b4743322c672183cbb62bebec5c51ff3e7cb6b662d1c0688715d"}
Jul 29 06:31:51.036903 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.036876    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:51.094639 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.094602    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-util\") pod \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") "
Jul 29 06:31:51.094830 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.094741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpdjv\" (UniqueName: \"kubernetes.io/projected/151da502-c4cd-43b5-a9a7-8c048e4e19cd-kube-api-access-lpdjv\") pod \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") "
Jul 29 06:31:51.094830 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.094781    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-bundle\") pod \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\" (UID: \"151da502-c4cd-43b5-a9a7-8c048e4e19cd\") "
Jul 29 06:31:51.095310 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.095283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-bundle" (OuterVolumeSpecName: "bundle") pod "151da502-c4cd-43b5-a9a7-8c048e4e19cd" (UID: "151da502-c4cd-43b5-a9a7-8c048e4e19cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:31:51.097409 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.097373    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/151da502-c4cd-43b5-a9a7-8c048e4e19cd-kube-api-access-lpdjv" (OuterVolumeSpecName: "kube-api-access-lpdjv") pod "151da502-c4cd-43b5-a9a7-8c048e4e19cd" (UID: "151da502-c4cd-43b5-a9a7-8c048e4e19cd"). InnerVolumeSpecName "kube-api-access-lpdjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:31:51.100271 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.100248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-util" (OuterVolumeSpecName: "util") pod "151da502-c4cd-43b5-a9a7-8c048e4e19cd" (UID: "151da502-c4cd-43b5-a9a7-8c048e4e19cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:31:51.196179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.196102    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:51.196179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.196137    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/151da502-c4cd-43b5-a9a7-8c048e4e19cd-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:51.196179 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.196152    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpdjv\" (UniqueName: \"kubernetes.io/projected/151da502-c4cd-43b5-a9a7-8c048e4e19cd-kube-api-access-lpdjv\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:31:51.901150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.901114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg" event={"ID":"151da502-c4cd-43b5-a9a7-8c048e4e19cd","Type":"ContainerDied","Data":"b680feb6739f2569d8bcbe83e5f11382add5bcfd079033b9739fe87b5c47c689"}
Jul 29 06:31:51.901150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.901141    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdthsg"
Jul 29 06:31:51.901599 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:51.901164    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b680feb6739f2569d8bcbe83e5f11382add5bcfd079033b9739fe87b5c47c689"
Jul 29 06:31:53.909896 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:53.909861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r" event={"ID":"6ac58575-0808-41dc-9760-f08731a9ab2a","Type":"ContainerStarted","Data":"173f3425ac44968843e645fa28524423fb94893bfcfb624cc0f9b07ff0b45e39"}
Jul 29 06:31:53.910279 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:53.909940    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:53.925129 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:53.925080    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r" podStartSLOduration=1.7205997960000001 podStartE2EDuration="4.925061831s" totalImagesPullingTime="3.204462035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:31:53.923982776 +0000 UTC m=+555.559574567" watchObservedRunningTime="2026-07-29 06:31:53.925061831 +0000 UTC m=+555.560653622"
Jul 29 06:31:59.097462 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097425    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"]
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097720    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="pull"
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097730    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="pull"
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097744    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="extract"
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097749    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="extract"
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097759    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="util"
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097766    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="util"
Jul 29 06:31:59.097880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.097816    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="151da502-c4cd-43b5-a9a7-8c048e4e19cd" containerName="extract"
Jul 29 06:31:59.101652 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.101636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.104010 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.103990    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 06:31:59.104809 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.104794    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 06:31:59.104865 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.104812    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7d862\""
Jul 29 06:31:59.109331 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.109311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"]
Jul 29 06:31:59.159590 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.159565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf79b14-5863-484d-afdd-85ae46955b5e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8mzd7\" (UID: \"ecf79b14-5863-484d-afdd-85ae46955b5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.159754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.159607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfjrg\" (UniqueName: \"kubernetes.io/projected/ecf79b14-5863-484d-afdd-85ae46955b5e-kube-api-access-hfjrg\") pod \"openshift-lws-operator-fd8ccff4c-8mzd7\" (UID: \"ecf79b14-5863-484d-afdd-85ae46955b5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.260009 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.259978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf79b14-5863-484d-afdd-85ae46955b5e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8mzd7\" (UID: \"ecf79b14-5863-484d-afdd-85ae46955b5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.260193 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.260025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjrg\" (UniqueName: \"kubernetes.io/projected/ecf79b14-5863-484d-afdd-85ae46955b5e-kube-api-access-hfjrg\") pod \"openshift-lws-operator-fd8ccff4c-8mzd7\" (UID: \"ecf79b14-5863-484d-afdd-85ae46955b5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.260385 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.260366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf79b14-5863-484d-afdd-85ae46955b5e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8mzd7\" (UID: \"ecf79b14-5863-484d-afdd-85ae46955b5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.268382 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.268356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfjrg\" (UniqueName: \"kubernetes.io/projected/ecf79b14-5863-484d-afdd-85ae46955b5e-kube-api-access-hfjrg\") pod \"openshift-lws-operator-fd8ccff4c-8mzd7\" (UID: \"ecf79b14-5863-484d-afdd-85ae46955b5e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.411073 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.411035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"
Jul 29 06:31:59.535468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.535444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7"]
Jul 29 06:31:59.538166 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:31:59.538128    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecf79b14_5863_484d_afdd_85ae46955b5e.slice/crio-6c15bc2a565b6589aeb08bf872490607277d631259f38cd64afe295090cc0f1e WatchSource:0}: Error finding container 6c15bc2a565b6589aeb08bf872490607277d631259f38cd64afe295090cc0f1e: Status 404 returned error can't find the container with id 6c15bc2a565b6589aeb08bf872490607277d631259f38cd64afe295090cc0f1e
Jul 29 06:31:59.915876 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.915850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2hv5r"
Jul 29 06:31:59.935976 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:31:59.935941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7" event={"ID":"ecf79b14-5863-484d-afdd-85ae46955b5e","Type":"ContainerStarted","Data":"6c15bc2a565b6589aeb08bf872490607277d631259f38cd64afe295090cc0f1e"}
Jul 29 06:32:01.947059 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:01.947021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7" event={"ID":"ecf79b14-5863-484d-afdd-85ae46955b5e","Type":"ContainerStarted","Data":"c5e5c74c9bb02236360f8ed6fd32588072fa013f10a6259f575cae86312ffb2e"}
Jul 29 06:32:01.962533 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:01.962486    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mzd7" podStartSLOduration=1.2844780390000001 podStartE2EDuration="2.962470809s" totalImagesPullingTime="1.67799277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:01.961170641 +0000 UTC m=+563.596762451" watchObservedRunningTime="2026-07-29 06:32:01.962470809 +0000 UTC m=+563.598062600"
Jul 29 06:32:04.726604 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.726566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"]
Jul 29 06:32:04.735300 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.735273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.736948 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.736921    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"]
Jul 29 06:32:04.737640 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.737621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m9mnn\""
Jul 29 06:32:04.737872 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.737839    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 06:32:04.738636 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.738617    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 06:32:04.808506 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.808465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jnw\" (UniqueName: \"kubernetes.io/projected/c93de804-c578-47c7-bc9b-cf4a44a1125b-kube-api-access-h2jnw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.808506 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.808511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.808761 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.808531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.909145 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.909113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jnw\" (UniqueName: \"kubernetes.io/projected/c93de804-c578-47c7-bc9b-cf4a44a1125b-kube-api-access-h2jnw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.909316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.909175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.909316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.909194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.909579 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.909558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.909619 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.909587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:04.917323 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:04.917297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jnw\" (UniqueName: \"kubernetes.io/projected/c93de804-c578-47c7-bc9b-cf4a44a1125b-kube-api-access-h2jnw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:05.045896 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:05.045812    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:05.198364 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:05.198339    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"]
Jul 29 06:32:05.200456 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:05.200430    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93de804_c578_47c7_bc9b_cf4a44a1125b.slice/crio-3e7c526f99e476f4b09ec9ab78ee0765dde99ee67afce3a1c7194536ca0b3568 WatchSource:0}: Error finding container 3e7c526f99e476f4b09ec9ab78ee0765dde99ee67afce3a1c7194536ca0b3568: Status 404 returned error can't find the container with id 3e7c526f99e476f4b09ec9ab78ee0765dde99ee67afce3a1c7194536ca0b3568
Jul 29 06:32:05.964584 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:05.964555    2578 generic.go:356] "Generic (PLEG): container finished" podID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerID="6f6a73f77121a0499d4754b33f4ce272984c491fe9993aa1d8cdcb8e2bb7e396" exitCode=0
Jul 29 06:32:05.965019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:05.964650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v" event={"ID":"c93de804-c578-47c7-bc9b-cf4a44a1125b","Type":"ContainerDied","Data":"6f6a73f77121a0499d4754b33f4ce272984c491fe9993aa1d8cdcb8e2bb7e396"}
Jul 29 06:32:05.965019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:05.964695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v" event={"ID":"c93de804-c578-47c7-bc9b-cf4a44a1125b","Type":"ContainerStarted","Data":"3e7c526f99e476f4b09ec9ab78ee0765dde99ee67afce3a1c7194536ca0b3568"}
Jul 29 06:32:07.979458 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:07.979420    2578 generic.go:356] "Generic (PLEG): container finished" podID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerID="78193aa80d8bd0ed54fbd668e503269e6b06df33c9f0bb31d3e5d6c42dc04697" exitCode=0
Jul 29 06:32:07.979881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:07.979471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v" event={"ID":"c93de804-c578-47c7-bc9b-cf4a44a1125b","Type":"ContainerDied","Data":"78193aa80d8bd0ed54fbd668e503269e6b06df33c9f0bb31d3e5d6c42dc04697"}
Jul 29 06:32:08.985972 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:08.985933    2578 generic.go:356] "Generic (PLEG): container finished" podID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerID="6f481d175ba71e581c57529208cbe6badd91c204198bdcfcdf498fbfa18d8d9b" exitCode=0
Jul 29 06:32:08.986337 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:08.986007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v" event={"ID":"c93de804-c578-47c7-bc9b-cf4a44a1125b","Type":"ContainerDied","Data":"6f481d175ba71e581c57529208cbe6badd91c204198bdcfcdf498fbfa18d8d9b"}
Jul 29 06:32:10.117623 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.117598    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:10.255134 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.255058    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-bundle\") pod \"c93de804-c578-47c7-bc9b-cf4a44a1125b\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") "
Jul 29 06:32:10.255134 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.255106    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-util\") pod \"c93de804-c578-47c7-bc9b-cf4a44a1125b\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") "
Jul 29 06:32:10.255307 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.255171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2jnw\" (UniqueName: \"kubernetes.io/projected/c93de804-c578-47c7-bc9b-cf4a44a1125b-kube-api-access-h2jnw\") pod \"c93de804-c578-47c7-bc9b-cf4a44a1125b\" (UID: \"c93de804-c578-47c7-bc9b-cf4a44a1125b\") "
Jul 29 06:32:10.255877 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.255856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-bundle" (OuterVolumeSpecName: "bundle") pod "c93de804-c578-47c7-bc9b-cf4a44a1125b" (UID: "c93de804-c578-47c7-bc9b-cf4a44a1125b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:32:10.257397 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.257375    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c93de804-c578-47c7-bc9b-cf4a44a1125b-kube-api-access-h2jnw" (OuterVolumeSpecName: "kube-api-access-h2jnw") pod "c93de804-c578-47c7-bc9b-cf4a44a1125b" (UID: "c93de804-c578-47c7-bc9b-cf4a44a1125b"). InnerVolumeSpecName "kube-api-access-h2jnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:32:10.260920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.260897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-util" (OuterVolumeSpecName: "util") pod "c93de804-c578-47c7-bc9b-cf4a44a1125b" (UID: "c93de804-c578-47c7-bc9b-cf4a44a1125b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:32:10.355960 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.355910    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2jnw\" (UniqueName: \"kubernetes.io/projected/c93de804-c578-47c7-bc9b-cf4a44a1125b-kube-api-access-h2jnw\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:32:10.355960 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.355954    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:32:10.355960 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.355963    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c93de804-c578-47c7-bc9b-cf4a44a1125b-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:32:10.997617 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.997581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v" event={"ID":"c93de804-c578-47c7-bc9b-cf4a44a1125b","Type":"ContainerDied","Data":"3e7c526f99e476f4b09ec9ab78ee0765dde99ee67afce3a1c7194536ca0b3568"}
Jul 29 06:32:10.997617 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.997602    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjdk4v"
Jul 29 06:32:10.997882 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:10.997633    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e7c526f99e476f4b09ec9ab78ee0765dde99ee67afce3a1c7194536ca0b3568"
Jul 29 06:32:22.813111 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813070    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"]
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813385    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="extract"
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813396    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="extract"
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813414    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="util"
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813430    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="util"
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813447    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="pull"
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813452    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="pull"
Jul 29 06:32:22.813576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.813511    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93de804-c578-47c7-bc9b-cf4a44a1125b" containerName="extract"
Jul 29 06:32:22.818127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.818103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.821228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.821207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 06:32:22.821686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.821658    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 06:32:22.821921 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.821910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 06:32:22.821971 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.821963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 06:32:22.822382 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.822368    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdzx8\""
Jul 29 06:32:22.838140 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.838115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"]
Jul 29 06:32:22.855728 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.855678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddpt5\" (UniqueName: \"kubernetes.io/projected/e72efaa4-3347-4e56-873d-024991ad9fd6-kube-api-access-ddpt5\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.855887 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.855867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e72efaa4-3347-4e56-873d-024991ad9fd6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.855961 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.855927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e72efaa4-3347-4e56-873d-024991ad9fd6-tmp\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.855961 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.855952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e72efaa4-3347-4e56-873d-024991ad9fd6-manifests\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.856062 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.855986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e72efaa4-3347-4e56-873d-024991ad9fd6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.956440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.956406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e72efaa4-3347-4e56-873d-024991ad9fd6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.956599 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.956448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e72efaa4-3347-4e56-873d-024991ad9fd6-tmp\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.956599 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.956465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e72efaa4-3347-4e56-873d-024991ad9fd6-manifests\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.956687 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.956594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e72efaa4-3347-4e56-873d-024991ad9fd6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.956687 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.956649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddpt5\" (UniqueName: \"kubernetes.io/projected/e72efaa4-3347-4e56-873d-024991ad9fd6-kube-api-access-ddpt5\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.956894 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.956852    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e72efaa4-3347-4e56-873d-024991ad9fd6-manifests\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.958890 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.958869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e72efaa4-3347-4e56-873d-024991ad9fd6-tmp\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.959126 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.959108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e72efaa4-3347-4e56-873d-024991ad9fd6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.959188 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.959155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e72efaa4-3347-4e56-873d-024991ad9fd6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:22.965544 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:22.965524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddpt5\" (UniqueName: \"kubernetes.io/projected/e72efaa4-3347-4e56-873d-024991ad9fd6-kube-api-access-ddpt5\") pod \"opendatahub-operator-controller-manager-7d6c7945d7-rm6gh\" (UID: \"e72efaa4-3347-4e56-873d-024991ad9fd6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:23.128607 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:23.128579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:23.269972 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:23.269946    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"]
Jul 29 06:32:23.272525 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:23.272495    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72efaa4_3347_4e56_873d_024991ad9fd6.slice/crio-15590b070a2d65297c35e33956dfd7d6f5da7af15701e3ceeaa91708df302b64 WatchSource:0}: Error finding container 15590b070a2d65297c35e33956dfd7d6f5da7af15701e3ceeaa91708df302b64: Status 404 returned error can't find the container with id 15590b070a2d65297c35e33956dfd7d6f5da7af15701e3ceeaa91708df302b64
Jul 29 06:32:24.056273 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:24.056229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh" event={"ID":"e72efaa4-3347-4e56-873d-024991ad9fd6","Type":"ContainerStarted","Data":"15590b070a2d65297c35e33956dfd7d6f5da7af15701e3ceeaa91708df302b64"}
Jul 29 06:32:27.076763 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:27.076724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh" event={"ID":"e72efaa4-3347-4e56-873d-024991ad9fd6","Type":"ContainerStarted","Data":"f3178e0c21f030f381f84540b997c71238642378824bd3ba1ac099493258339f"}
Jul 29 06:32:28.082914 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:28.082876    2578 generic.go:356] "Generic (PLEG): container finished" podID="e72efaa4-3347-4e56-873d-024991ad9fd6" containerID="f3178e0c21f030f381f84540b997c71238642378824bd3ba1ac099493258339f" exitCode=0
Jul 29 06:32:28.083316 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:28.082972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh" event={"ID":"e72efaa4-3347-4e56-873d-024991ad9fd6","Type":"ContainerDied","Data":"f3178e0c21f030f381f84540b997c71238642378824bd3ba1ac099493258339f"}
Jul 29 06:32:29.089289 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:29.089242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh" event={"ID":"e72efaa4-3347-4e56-873d-024991ad9fd6","Type":"ContainerStarted","Data":"9541ca3fc4e7a8713faa08a4ac40d61ccffb48768bb81a4cca292f5003de77c0"}
Jul 29 06:32:29.089762 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:29.089342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:29.111385 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:29.111335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh" podStartSLOduration=2.728778996 podStartE2EDuration="7.111319428s" totalImagesPullingTime="3.288209597s" totalInitContainerRuntime="1.094330835s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:29.109020337 +0000 UTC m=+590.744612128" watchObservedRunningTime="2026-07-29 06:32:29.111319428 +0000 UTC m=+590.746911218"
Jul 29 06:32:38.798520 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:38.798491    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:32:38.799410 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:38.799390    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:32:38.803294 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:38.803256    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:32:38.804499 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:38.804481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:32:40.099741 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:40.099690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d6c7945d7-rm6gh"
Jul 29 06:32:42.678746 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.678691    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4wcw4"]
Jul 29 06:32:42.681243 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.681225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:42.683841 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.683818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 06:32:42.683935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.683824    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pb4hj\""
Jul 29 06:32:42.691857 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.691835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4wcw4"]
Jul 29 06:32:42.694123 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.694103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:42.694222 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.694135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxsvt\" (UniqueName: \"kubernetes.io/projected/460b74e1-0c98-4546-8cff-793cdf55a4f7-kube-api-access-bxsvt\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:42.795373 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.795339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:42.795373 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.795379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxsvt\" (UniqueName: \"kubernetes.io/projected/460b74e1-0c98-4546-8cff-793cdf55a4f7-kube-api-access-bxsvt\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:42.795579 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:42.795506    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 06:32:42.795579 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:42.795567    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert podName:460b74e1-0c98-4546-8cff-793cdf55a4f7 nodeName:}" failed. No retries permitted until 2026-07-29 06:32:43.295550587 +0000 UTC m=+604.931142357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert") pod "odh-model-controller-7998c67dc4-4wcw4" (UID: "460b74e1-0c98-4546-8cff-793cdf55a4f7") : secret "odh-model-controller-webhook-cert" not found
Jul 29 06:32:42.803525 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:42.803496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxsvt\" (UniqueName: \"kubernetes.io/projected/460b74e1-0c98-4546-8cff-793cdf55a4f7-kube-api-access-bxsvt\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:43.283531 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.283503    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-czmfw"]
Jul 29 06:32:43.285938 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.285918    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.288464 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.288441    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 06:32:43.298474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.298449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-czmfw"]
Jul 29 06:32:43.298968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.298945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95757fa3-dbe0-4bdf-8076-083256da481b-tls-certs\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.299101 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.299082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:43.299174 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.299147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhn2\" (UniqueName: \"kubernetes.io/projected/95757fa3-dbe0-4bdf-8076-083256da481b-kube-api-access-5dhn2\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.299253 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:43.299234    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 06:32:43.299324 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:43.299313    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert podName:460b74e1-0c98-4546-8cff-793cdf55a4f7 nodeName:}" failed. No retries permitted until 2026-07-29 06:32:44.299293592 +0000 UTC m=+605.934885363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert") pod "odh-model-controller-7998c67dc4-4wcw4" (UID: "460b74e1-0c98-4546-8cff-793cdf55a4f7") : secret "odh-model-controller-webhook-cert" not found
Jul 29 06:32:43.400638 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.400598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhn2\" (UniqueName: \"kubernetes.io/projected/95757fa3-dbe0-4bdf-8076-083256da481b-kube-api-access-5dhn2\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.400978 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.400945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95757fa3-dbe0-4bdf-8076-083256da481b-tls-certs\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.401147 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:43.401124    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 29 06:32:43.401232 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:43.401206    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95757fa3-dbe0-4bdf-8076-083256da481b-tls-certs podName:95757fa3-dbe0-4bdf-8076-083256da481b nodeName:}" failed. No retries permitted until 2026-07-29 06:32:43.901183967 +0000 UTC m=+605.536775752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/95757fa3-dbe0-4bdf-8076-083256da481b-tls-certs") pod "model-serving-api-54d89bd5fc-czmfw" (UID: "95757fa3-dbe0-4bdf-8076-083256da481b") : secret "model-serving-api-tls" not found
Jul 29 06:32:43.408350 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.408324    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhn2\" (UniqueName: \"kubernetes.io/projected/95757fa3-dbe0-4bdf-8076-083256da481b-kube-api-access-5dhn2\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.905521 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.905482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95757fa3-dbe0-4bdf-8076-083256da481b-tls-certs\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:43.908122 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:43.908097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95757fa3-dbe0-4bdf-8076-083256da481b-tls-certs\") pod \"model-serving-api-54d89bd5fc-czmfw\" (UID: \"95757fa3-dbe0-4bdf-8076-083256da481b\") " pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:44.196892 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.196805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:44.314371 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.313884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:44.316985 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.316960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/460b74e1-0c98-4546-8cff-793cdf55a4f7-cert\") pod \"odh-model-controller-7998c67dc4-4wcw4\" (UID: \"460b74e1-0c98-4546-8cff-793cdf55a4f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:44.334005 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.333986    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-czmfw"]
Jul 29 06:32:44.336442 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:44.336416    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95757fa3_dbe0_4bdf_8076_083256da481b.slice/crio-00df47aba37ebddd7d969ff4a148253bbc5b57132e7a46d5015f4e2d48b1d7ff WatchSource:0}: Error finding container 00df47aba37ebddd7d969ff4a148253bbc5b57132e7a46d5015f4e2d48b1d7ff: Status 404 returned error can't find the container with id 00df47aba37ebddd7d969ff4a148253bbc5b57132e7a46d5015f4e2d48b1d7ff
Jul 29 06:32:44.338129 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.338114    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 06:32:44.491493 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.491404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:44.619762 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:44.619739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4wcw4"]
Jul 29 06:32:44.621983 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:44.621957    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460b74e1_0c98_4546_8cff_793cdf55a4f7.slice/crio-aa4b2159d5e523911dff57199d8ba8835e559550d759cdceb09e05440ab06709 WatchSource:0}: Error finding container aa4b2159d5e523911dff57199d8ba8835e559550d759cdceb09e05440ab06709: Status 404 returned error can't find the container with id aa4b2159d5e523911dff57199d8ba8835e559550d759cdceb09e05440ab06709
Jul 29 06:32:45.172154 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:45.172116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4" event={"ID":"460b74e1-0c98-4546-8cff-793cdf55a4f7","Type":"ContainerStarted","Data":"aa4b2159d5e523911dff57199d8ba8835e559550d759cdceb09e05440ab06709"}
Jul 29 06:32:45.173431 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:45.173392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw" event={"ID":"95757fa3-dbe0-4bdf-8076-083256da481b","Type":"ContainerStarted","Data":"00df47aba37ebddd7d969ff4a148253bbc5b57132e7a46d5015f4e2d48b1d7ff"}
Jul 29 06:32:46.179951 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:46.179919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw" event={"ID":"95757fa3-dbe0-4bdf-8076-083256da481b","Type":"ContainerStarted","Data":"1c289b50dae597cea698dc0167a835bec7b07d168d00fb75561921b6faa48039"}
Jul 29 06:32:46.180388 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:46.180009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:46.197735 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:46.197663    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw" podStartSLOduration=1.5525566400000002 podStartE2EDuration="3.197646802s" totalImagesPullingTime="1.645090162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:46.195235669 +0000 UTC m=+607.830827481" watchObservedRunningTime="2026-07-29 06:32:46.197646802 +0000 UTC m=+607.833238593"
Jul 29 06:32:48.193244 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:48.193205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4" event={"ID":"460b74e1-0c98-4546-8cff-793cdf55a4f7","Type":"ContainerStarted","Data":"484580ef1da9c18ad501b21ab8f8cc6114ab776e83ed86b7816347885f64e01f"}
Jul 29 06:32:48.193615 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:48.193268    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:48.216702 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:48.216641    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4" podStartSLOduration=3.4100522189999998 podStartE2EDuration="6.21662517s" totalImagesPullingTime="2.806572951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:48.215250455 +0000 UTC m=+609.850842247" watchObservedRunningTime="2026-07-29 06:32:48.21662517 +0000 UTC m=+609.852216960"
Jul 29 06:32:51.314564 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.314521    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"]
Jul 29 06:32:51.316824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.316806    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.319800 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.319768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 06:32:51.319800 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.319795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2c45p\""
Jul 29 06:32:51.328822 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.328798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"]
Jul 29 06:32:51.335327 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.335301    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"]
Jul 29 06:32:51.337982 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.337965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.340368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.340346    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s68sg\""
Jul 29 06:32:51.340474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.340420    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 06:32:51.348862 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.348138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"]
Jul 29 06:32:51.378036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.378001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3a0fc9d-54ac-42a6-a165-9bab5a714b38-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fzvcc\" (UID: \"b3a0fc9d-54ac-42a6-a165-9bab5a714b38\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.378201 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.378052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1-cert\") pod \"kserve-controller-manager-d6f4b65b8-jzx29\" (UID: \"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.378201 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.378146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4bjm\" (UniqueName: \"kubernetes.io/projected/b3a0fc9d-54ac-42a6-a165-9bab5a714b38-kube-api-access-t4bjm\") pod \"llmisvc-controller-manager-777c6bd7d5-fzvcc\" (UID: \"b3a0fc9d-54ac-42a6-a165-9bab5a714b38\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.378288 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.378206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfchk\" (UniqueName: \"kubernetes.io/projected/da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1-kube-api-access-xfchk\") pod \"kserve-controller-manager-d6f4b65b8-jzx29\" (UID: \"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.479363 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.479331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfchk\" (UniqueName: \"kubernetes.io/projected/da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1-kube-api-access-xfchk\") pod \"kserve-controller-manager-d6f4b65b8-jzx29\" (UID: \"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.479562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.479373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3a0fc9d-54ac-42a6-a165-9bab5a714b38-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fzvcc\" (UID: \"b3a0fc9d-54ac-42a6-a165-9bab5a714b38\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.479562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.479408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1-cert\") pod \"kserve-controller-manager-d6f4b65b8-jzx29\" (UID: \"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.479562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.479469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4bjm\" (UniqueName: \"kubernetes.io/projected/b3a0fc9d-54ac-42a6-a165-9bab5a714b38-kube-api-access-t4bjm\") pod \"llmisvc-controller-manager-777c6bd7d5-fzvcc\" (UID: \"b3a0fc9d-54ac-42a6-a165-9bab5a714b38\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.482135 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.482111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1-cert\") pod \"kserve-controller-manager-d6f4b65b8-jzx29\" (UID: \"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.482261 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.482131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3a0fc9d-54ac-42a6-a165-9bab5a714b38-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fzvcc\" (UID: \"b3a0fc9d-54ac-42a6-a165-9bab5a714b38\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.487920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.487894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4bjm\" (UniqueName: \"kubernetes.io/projected/b3a0fc9d-54ac-42a6-a165-9bab5a714b38-kube-api-access-t4bjm\") pod \"llmisvc-controller-manager-777c6bd7d5-fzvcc\" (UID: \"b3a0fc9d-54ac-42a6-a165-9bab5a714b38\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.488308 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.488288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfchk\" (UniqueName: \"kubernetes.io/projected/da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1-kube-api-access-xfchk\") pod \"kserve-controller-manager-d6f4b65b8-jzx29\" (UID: \"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.626630 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.626601    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:51.652908 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.652872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:51.783851 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.783644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"]
Jul 29 06:32:51.786239 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:51.786214    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda68fc5d_b32e_4bfe_9ffa_ddf60d674ba1.slice/crio-0d11052aa319bc30c52b982b6a6aa069efa2a9bc85a1164d2a47c5776d5f0fcf WatchSource:0}: Error finding container 0d11052aa319bc30c52b982b6a6aa069efa2a9bc85a1164d2a47c5776d5f0fcf: Status 404 returned error can't find the container with id 0d11052aa319bc30c52b982b6a6aa069efa2a9bc85a1164d2a47c5776d5f0fcf
Jul 29 06:32:51.807890 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:51.807863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"]
Jul 29 06:32:51.810513 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:51.810460    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb3a0fc9d_54ac_42a6_a165_9bab5a714b38.slice/crio-ca6988b19b10d931f5dd1b59840e8a7ab279dd1f05d165508afccf54fa979bc9 WatchSource:0}: Error finding container ca6988b19b10d931f5dd1b59840e8a7ab279dd1f05d165508afccf54fa979bc9: Status 404 returned error can't find the container with id ca6988b19b10d931f5dd1b59840e8a7ab279dd1f05d165508afccf54fa979bc9
Jul 29 06:32:52.219092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.219051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc" event={"ID":"b3a0fc9d-54ac-42a6-a165-9bab5a714b38","Type":"ContainerStarted","Data":"ca6988b19b10d931f5dd1b59840e8a7ab279dd1f05d165508afccf54fa979bc9"}
Jul 29 06:32:52.220162 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.220142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29" event={"ID":"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1","Type":"ContainerStarted","Data":"0d11052aa319bc30c52b982b6a6aa069efa2a9bc85a1164d2a47c5776d5f0fcf"}
Jul 29 06:32:52.934392 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.933366    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"]
Jul 29 06:32:52.936310 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.936287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:52.940531 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.940484    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 06:32:52.941055 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.940876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 06:32:52.968052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.967995    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"]
Jul 29 06:32:52.998220 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.996993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19955dba-22ce-4b39-84e0-c92b48a5ca94-tls-certs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:52.998220 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.997046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjmzs\" (UniqueName: \"kubernetes.io/projected/19955dba-22ce-4b39-84e0-c92b48a5ca94-kube-api-access-jjmzs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:52.998220 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:52.997075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19955dba-22ce-4b39-84e0-c92b48a5ca94-tmp\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.099036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.098130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19955dba-22ce-4b39-84e0-c92b48a5ca94-tls-certs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.099036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.098179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjmzs\" (UniqueName: \"kubernetes.io/projected/19955dba-22ce-4b39-84e0-c92b48a5ca94-kube-api-access-jjmzs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.099036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.098205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19955dba-22ce-4b39-84e0-c92b48a5ca94-tmp\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.099036 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:53.098703    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 29 06:32:53.099036 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:32:53.098809    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19955dba-22ce-4b39-84e0-c92b48a5ca94-tls-certs podName:19955dba-22ce-4b39-84e0-c92b48a5ca94 nodeName:}" failed. No retries permitted until 2026-07-29 06:32:53.598785832 +0000 UTC m=+615.234377601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/19955dba-22ce-4b39-84e0-c92b48a5ca94-tls-certs") pod "kube-auth-proxy-5c857974d4-r6zml" (UID: "19955dba-22ce-4b39-84e0-c92b48a5ca94") : secret "kube-auth-proxy-tls" not found
Jul 29 06:32:53.106069 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.105989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19955dba-22ce-4b39-84e0-c92b48a5ca94-tmp\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.115419 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.114857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjmzs\" (UniqueName: \"kubernetes.io/projected/19955dba-22ce-4b39-84e0-c92b48a5ca94-kube-api-access-jjmzs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.602385 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.602273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19955dba-22ce-4b39-84e0-c92b48a5ca94-tls-certs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.605343 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.605306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19955dba-22ce-4b39-84e0-c92b48a5ca94-tls-certs\") pod \"kube-auth-proxy-5c857974d4-r6zml\" (UID: \"19955dba-22ce-4b39-84e0-c92b48a5ca94\") " pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:53.854485 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:53.854390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"
Jul 29 06:32:54.333296 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.333186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c857974d4-r6zml"]
Jul 29 06:32:54.477074 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.476980    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"]
Jul 29 06:32:54.480429 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.480402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.482838 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.482818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 06:32:54.482955 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.482881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bdtzz\""
Jul 29 06:32:54.483315 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.483292    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 06:32:54.483426 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.483301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 06:32:54.483426 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.483329    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 06:32:54.493238 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.493217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"]
Jul 29 06:32:54.512015 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.511984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.512169 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.512037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4g8d\" (UniqueName: \"kubernetes.io/projected/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-kube-api-access-v4g8d\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.512169 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.512065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.512169 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.512146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.512333 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.512204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.512333 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.512283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.512436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.512328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.612968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.612927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.613163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.612997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4g8d\" (UniqueName: \"kubernetes.io/projected/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-kube-api-access-v4g8d\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.613163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.613032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.613163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.613080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.613163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.613120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.613163 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.613159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.613410 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.613182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.614073 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.613959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.616076 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.616047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.616172 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.616055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.616172 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.616138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.616420 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.616397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.621857 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.621831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4g8d\" (UniqueName: \"kubernetes.io/projected/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-kube-api-access-v4g8d\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.621978 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.621890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-hz7x2\" (UID: \"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.784587 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:54.784513    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19955dba_22ce_4b39_84e0_c92b48a5ca94.slice/crio-a1268eca7208de9d03ad7b2eafc91b3fd4e4f4639955694ebaaeeee4c1bc7fbf WatchSource:0}: Error finding container a1268eca7208de9d03ad7b2eafc91b3fd4e4f4639955694ebaaeeee4c1bc7fbf: Status 404 returned error can't find the container with id a1268eca7208de9d03ad7b2eafc91b3fd4e4f4639955694ebaaeeee4c1bc7fbf
Jul 29 06:32:54.793761 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.793739    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:54.957213 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:54.957182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"]
Jul 29 06:32:54.960067 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:32:54.960046    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce7fbb5_95e3_482b_8c56_7cfeca34ebf9.slice/crio-fdd81ffa288be614e7360d9b35746a93e048873e22ecafd619e1875e0e84672c WatchSource:0}: Error finding container fdd81ffa288be614e7360d9b35746a93e048873e22ecafd619e1875e0e84672c: Status 404 returned error can't find the container with id fdd81ffa288be614e7360d9b35746a93e048873e22ecafd619e1875e0e84672c
Jul 29 06:32:55.245916 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.245878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2" event={"ID":"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9","Type":"ContainerStarted","Data":"fdd81ffa288be614e7360d9b35746a93e048873e22ecafd619e1875e0e84672c"}
Jul 29 06:32:55.248564 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.248525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc" event={"ID":"b3a0fc9d-54ac-42a6-a165-9bab5a714b38","Type":"ContainerStarted","Data":"50da16589696267e0188e68c6403026aa07acc25e8c152fb356f341edb8293d9"}
Jul 29 06:32:55.249069 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.249001    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:32:55.251537 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.251505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29" event={"ID":"da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1","Type":"ContainerStarted","Data":"1c3a851f709a519e2f9303753228182cbfc7d067548269ffcdb8e334a05869be"}
Jul 29 06:32:55.251639 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.251564    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:32:55.253387 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.253364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml" event={"ID":"19955dba-22ce-4b39-84e0-c92b48a5ca94","Type":"ContainerStarted","Data":"a1268eca7208de9d03ad7b2eafc91b3fd4e4f4639955694ebaaeeee4c1bc7fbf"}
Jul 29 06:32:55.267535 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.267477    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc" podStartSLOduration=1.26492757 podStartE2EDuration="4.267455861s" totalImagesPullingTime="3.002528291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:55.26400157 +0000 UTC m=+616.899593379" watchObservedRunningTime="2026-07-29 06:32:55.267455861 +0000 UTC m=+616.903047653"
Jul 29 06:32:55.278786 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:55.278728    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29" podStartSLOduration=1.2760338469999999 podStartE2EDuration="4.278693456s" totalImagesPullingTime="3.002659609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:55.278656653 +0000 UTC m=+616.914248444" watchObservedRunningTime="2026-07-29 06:32:55.278693456 +0000 UTC m=+616.914285248"
Jul 29 06:32:57.191264 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:57.191220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-czmfw"
Jul 29 06:32:58.176805 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.176677    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 06:32:58.176805 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.176773    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 06:32:58.273972 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.273943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2" event={"ID":"2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9","Type":"ContainerStarted","Data":"c58d5292ca3d7cdf2e9769cc22c22654e46038785ea9679819ee90d78a3e30eb"}
Jul 29 06:32:58.274627 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.274604    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:32:58.275899 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.275875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml" event={"ID":"19955dba-22ce-4b39-84e0-c92b48a5ca94","Type":"ContainerStarted","Data":"e11a91519756885512990b66cd8c94147e136edb04571e454933897f7144035a"}
Jul 29 06:32:58.292820 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.292765    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2" podStartSLOduration=1.0784073809999999 podStartE2EDuration="4.292744714s" totalImagesPullingTime="3.214337333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:58.291500328 +0000 UTC m=+619.927092133" watchObservedRunningTime="2026-07-29 06:32:58.292744714 +0000 UTC m=+619.928336506"
Jul 29 06:32:58.305728 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:58.305665    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c857974d4-r6zml" podStartSLOduration=2.919460449 podStartE2EDuration="6.3056491s" totalImagesPullingTime="3.386188651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:32:58.304504677 +0000 UTC m=+619.940096468" watchObservedRunningTime="2026-07-29 06:32:58.3056491 +0000 UTC m=+619.941240891"
Jul 29 06:32:59.199659 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:59.199631    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4wcw4"
Jul 29 06:32:59.282465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:59.282435    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-hz7x2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 06:32:59.282835 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:32:59.282485    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2" podUID="2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 06:33:00.291486 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:00.291456    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2"
Jul 29 06:33:26.263551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:26.263522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fzvcc"
Jul 29 06:33:26.266513 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:26.266496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jzx29"
Jul 29 06:33:51.085780 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.085747    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f49b66c86-8tjqn"]
Jul 29 06:33:51.088852 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.088831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.100657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.100633    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f49b66c86-8tjqn"]
Jul 29 06:33:51.204171 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-oauth-serving-cert\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.204171 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-service-ca\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.204436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4792dcc7-d017-4417-aed5-9a9d4e037992-console-serving-cert\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.204436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx4wc\" (UniqueName: \"kubernetes.io/projected/4792dcc7-d017-4417-aed5-9a9d4e037992-kube-api-access-dx4wc\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.204436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-trusted-ca-bundle\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.204436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4792dcc7-d017-4417-aed5-9a9d4e037992-console-oauth-config\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.204436 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.204387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-console-config\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.305768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4792dcc7-d017-4417-aed5-9a9d4e037992-console-serving-cert\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.305768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx4wc\" (UniqueName: \"kubernetes.io/projected/4792dcc7-d017-4417-aed5-9a9d4e037992-kube-api-access-dx4wc\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-trusted-ca-bundle\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4792dcc7-d017-4417-aed5-9a9d4e037992-console-oauth-config\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-console-config\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-oauth-serving-cert\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.305922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-service-ca\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306624 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.306597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-console-config\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306753 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.306662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-service-ca\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306753 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.306662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-oauth-serving-cert\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.306863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.306781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4792dcc7-d017-4417-aed5-9a9d4e037992-trusted-ca-bundle\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.308907 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.308892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4792dcc7-d017-4417-aed5-9a9d4e037992-console-serving-cert\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.309038 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.309019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4792dcc7-d017-4417-aed5-9a9d4e037992-console-oauth-config\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.314395 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.314373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx4wc\" (UniqueName: \"kubernetes.io/projected/4792dcc7-d017-4417-aed5-9a9d4e037992-kube-api-access-dx4wc\") pod \"console-7f49b66c86-8tjqn\" (UID: \"4792dcc7-d017-4417-aed5-9a9d4e037992\") " pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.400379 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.400344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:33:51.535225 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:51.535202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f49b66c86-8tjqn"]
Jul 29 06:33:51.537509 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:33:51.537474    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4792dcc7_d017_4417_aed5_9a9d4e037992.slice/crio-558a495bdbbb33aad96b538e3b5d9bd04a34819ec4c23d302d2499cb224ce375 WatchSource:0}: Error finding container 558a495bdbbb33aad96b538e3b5d9bd04a34819ec4c23d302d2499cb224ce375: Status 404 returned error can't find the container with id 558a495bdbbb33aad96b538e3b5d9bd04a34819ec4c23d302d2499cb224ce375
Jul 29 06:33:52.535410 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:52.535375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f49b66c86-8tjqn" event={"ID":"4792dcc7-d017-4417-aed5-9a9d4e037992","Type":"ContainerStarted","Data":"b58b7f90c56339ee0262945e1d1f3f94fe0ea62b819a74ca4b2b21afbd4d1ef3"}
Jul 29 06:33:52.535826 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:52.535430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f49b66c86-8tjqn" event={"ID":"4792dcc7-d017-4417-aed5-9a9d4e037992","Type":"ContainerStarted","Data":"558a495bdbbb33aad96b538e3b5d9bd04a34819ec4c23d302d2499cb224ce375"}
Jul 29 06:33:52.552864 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:52.552815    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f49b66c86-8tjqn" podStartSLOduration=1.552798375 podStartE2EDuration="1.552798375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:33:52.55105839 +0000 UTC m=+674.186650181" watchObservedRunningTime="2026-07-29 06:33:52.552798375 +0000 UTC m=+674.188390165"
Jul 29 06:33:58.437510 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.437474    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"]
Jul 29 06:33:58.440148 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.440132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.442390 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.442369    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6llvq\""
Jul 29 06:33:58.442390 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.442375    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 06:33:58.442572 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.442375    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 06:33:58.448756 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.448401    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"]
Jul 29 06:33:58.565609 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.565579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnfk\" (UniqueName: \"kubernetes.io/projected/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-kube-api-access-4rnfk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.565609 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.565611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.565845 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.565772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.666301 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.666269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.666457 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.666315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnfk\" (UniqueName: \"kubernetes.io/projected/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-kube-api-access-4rnfk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.666457 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.666333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.666688 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.666672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.666750 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.666679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.673677 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.673645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnfk\" (UniqueName: \"kubernetes.io/projected/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-kube-api-access-4rnfk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.751144 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.751072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:33:58.880734 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:58.880684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"]
Jul 29 06:33:58.884075 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:33:58.884049    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bc4446_7c8d_4e04_80dd_a643c42d6bfe.slice/crio-f421050554b9166ce123a038f27c2e8a54af1fdfa1f1dd4328fac4ab72da1fb5 WatchSource:0}: Error finding container f421050554b9166ce123a038f27c2e8a54af1fdfa1f1dd4328fac4ab72da1fb5: Status 404 returned error can't find the container with id f421050554b9166ce123a038f27c2e8a54af1fdfa1f1dd4328fac4ab72da1fb5
Jul 29 06:33:59.229019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.228980    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"]
Jul 29 06:33:59.231670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.231654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.241440 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.241411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"]
Jul 29 06:33:59.371587 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.371560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.371789 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.371602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggrbn\" (UniqueName: \"kubernetes.io/projected/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-kube-api-access-ggrbn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.371789 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.371675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.473167 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.473132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.473532 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.473174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggrbn\" (UniqueName: \"kubernetes.io/projected/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-kube-api-access-ggrbn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.473532 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.473212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.473611 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.473527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.473611 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.473555    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.480863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.480802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggrbn\" (UniqueName: \"kubernetes.io/projected/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-kube-api-access-ggrbn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.541832 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.541803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:33:59.571419 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.571385    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerID="fb43fff0d639f98f09da0689e3daa8d5dded5c5f0cdd6a548c25220f4708ac43" exitCode=0
Jul 29 06:33:59.571558 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.571466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr" event={"ID":"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe","Type":"ContainerDied","Data":"fb43fff0d639f98f09da0689e3daa8d5dded5c5f0cdd6a548c25220f4708ac43"}
Jul 29 06:33:59.571558 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.571524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr" event={"ID":"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe","Type":"ContainerStarted","Data":"f421050554b9166ce123a038f27c2e8a54af1fdfa1f1dd4328fac4ab72da1fb5"}
Jul 29 06:33:59.677346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.677322    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"]
Jul 29 06:33:59.679150 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:33:59.679122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe66cc5e_8f69_43eb_a878_08a1626a0ce3.slice/crio-a17796d74a89936705ad89cd23dc848526efa154e9987effd5844c30a10c65b0 WatchSource:0}: Error finding container a17796d74a89936705ad89cd23dc848526efa154e9987effd5844c30a10c65b0: Status 404 returned error can't find the container with id a17796d74a89936705ad89cd23dc848526efa154e9987effd5844c30a10c65b0
Jul 29 06:33:59.830260 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.830228    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"]
Jul 29 06:33:59.833417 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.833398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:33:59.840511 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.840486    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"]
Jul 29 06:33:59.978535 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.978495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:33:59.978744 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.978554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277gh\" (UniqueName: \"kubernetes.io/projected/20183204-0d3c-4d21-bdb8-fade07f7d288-kube-api-access-277gh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:33:59.978744 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:33:59.978576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.079429 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.079347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.079429 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.079387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277gh\" (UniqueName: \"kubernetes.io/projected/20183204-0d3c-4d21-bdb8-fade07f7d288-kube-api-access-277gh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.079429 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.079411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.079759 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.079738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.079812 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.079794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.087414 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.087392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-277gh\" (UniqueName: \"kubernetes.io/projected/20183204-0d3c-4d21-bdb8-fade07f7d288-kube-api-access-277gh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.144608 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.144579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:00.232026 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.231998    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"]
Jul 29 06:34:00.237600 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.237579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.242206 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.242180    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"]
Jul 29 06:34:00.281585 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.281561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"]
Jul 29 06:34:00.284046 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:00.284018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20183204_0d3c_4d21_bdb8_fade07f7d288.slice/crio-563e463444290b222222747ad3c526633f20fe336da809829fa690261ba3802c WatchSource:0}: Error finding container 563e463444290b222222747ad3c526633f20fe336da809829fa690261ba3802c: Status 404 returned error can't find the container with id 563e463444290b222222747ad3c526633f20fe336da809829fa690261ba3802c
Jul 29 06:34:00.382704 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.382676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.382829 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.382766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqh8s\" (UniqueName: \"kubernetes.io/projected/611af5bb-899b-46ed-89d0-f9c39d08c173-kube-api-access-jqh8s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.382886 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.382833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.483412 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.483369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.483927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.483472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.483927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.483518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqh8s\" (UniqueName: \"kubernetes.io/projected/611af5bb-899b-46ed-89d0-f9c39d08c173-kube-api-access-jqh8s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.483927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.483848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.483927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.483888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.492311 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.492278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqh8s\" (UniqueName: \"kubernetes.io/projected/611af5bb-899b-46ed-89d0-f9c39d08c173-kube-api-access-jqh8s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.551224 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.551198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:00.579427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.579396    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerID="eb0f8ce0948c98918a1785e18b8faf519ad801773d3245c5ec70eacf031206fa" exitCode=0
Jul 29 06:34:00.579557 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.579475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg" event={"ID":"fe66cc5e-8f69-43eb-a878-08a1626a0ce3","Type":"ContainerDied","Data":"eb0f8ce0948c98918a1785e18b8faf519ad801773d3245c5ec70eacf031206fa"}
Jul 29 06:34:00.579557 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.579539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg" event={"ID":"fe66cc5e-8f69-43eb-a878-08a1626a0ce3","Type":"ContainerStarted","Data":"a17796d74a89936705ad89cd23dc848526efa154e9987effd5844c30a10c65b0"}
Jul 29 06:34:00.581534 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.581510    2578 generic.go:356] "Generic (PLEG): container finished" podID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerID="cba1c6d1b119cd10f8cff7e96289d253b1e8ea2783b4262ad173918ae8ac156e" exitCode=0
Jul 29 06:34:00.581635 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.581615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh" event={"ID":"20183204-0d3c-4d21-bdb8-fade07f7d288","Type":"ContainerDied","Data":"cba1c6d1b119cd10f8cff7e96289d253b1e8ea2783b4262ad173918ae8ac156e"}
Jul 29 06:34:00.581686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.581662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh" event={"ID":"20183204-0d3c-4d21-bdb8-fade07f7d288","Type":"ContainerStarted","Data":"563e463444290b222222747ad3c526633f20fe336da809829fa690261ba3802c"}
Jul 29 06:34:00.691027 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:00.691003    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"]
Jul 29 06:34:00.716640 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:00.716608    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611af5bb_899b_46ed_89d0_f9c39d08c173.slice/crio-ff34994a4201670137da55ca44e87f7495a7e183befb7bfe80463e7b5b8c4703 WatchSource:0}: Error finding container ff34994a4201670137da55ca44e87f7495a7e183befb7bfe80463e7b5b8c4703: Status 404 returned error can't find the container with id ff34994a4201670137da55ca44e87f7495a7e183befb7bfe80463e7b5b8c4703
Jul 29 06:34:01.400474 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.400447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:34:01.400621 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.400539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:34:01.405736 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.405688    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:34:01.587968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.587934    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerID="7377eb6f2195094aca0543ed474c195eaff9f9eafe427ad132a13be9b57e6f3b" exitCode=0
Jul 29 06:34:01.588352 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.588015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg" event={"ID":"fe66cc5e-8f69-43eb-a878-08a1626a0ce3","Type":"ContainerDied","Data":"7377eb6f2195094aca0543ed474c195eaff9f9eafe427ad132a13be9b57e6f3b"}
Jul 29 06:34:01.589979 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.589957    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerID="049d43d5c8e292cc19086b35de5da16bf06f774384ee0e1c9f99e249d8555bfb" exitCode=0
Jul 29 06:34:01.590085 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.590023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr" event={"ID":"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe","Type":"ContainerDied","Data":"049d43d5c8e292cc19086b35de5da16bf06f774384ee0e1c9f99e249d8555bfb"}
Jul 29 06:34:01.591970 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.591949    2578 generic.go:356] "Generic (PLEG): container finished" podID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerID="3d408573c8c97368084310f8f8cbc9ddeb48b3d189082122e8082f5a150a9a70" exitCode=0
Jul 29 06:34:01.592070 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.592019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh" event={"ID":"20183204-0d3c-4d21-bdb8-fade07f7d288","Type":"ContainerDied","Data":"3d408573c8c97368084310f8f8cbc9ddeb48b3d189082122e8082f5a150a9a70"}
Jul 29 06:34:01.593610 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.593574    2578 generic.go:356] "Generic (PLEG): container finished" podID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerID="78d42466ee283db096a71136bf0dffa98b255d7ef6711bb2920ae3cc23a8b7b8" exitCode=0
Jul 29 06:34:01.593688 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.593611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb" event={"ID":"611af5bb-899b-46ed-89d0-f9c39d08c173","Type":"ContainerDied","Data":"78d42466ee283db096a71136bf0dffa98b255d7ef6711bb2920ae3cc23a8b7b8"}
Jul 29 06:34:01.593688 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.593643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb" event={"ID":"611af5bb-899b-46ed-89d0-f9c39d08c173","Type":"ContainerStarted","Data":"ff34994a4201670137da55ca44e87f7495a7e183befb7bfe80463e7b5b8c4703"}
Jul 29 06:34:01.600501 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.600477    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f49b66c86-8tjqn"
Jul 29 06:34:01.667813 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:01.665308    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66489b9d84-fl8fz"]
Jul 29 06:34:02.607320 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.607283    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerID="d3f3cf1cea37b1add61c2ba46d7651fd3fec2f4e7f27ed1dac5c1f0bfbe4dcc9" exitCode=0
Jul 29 06:34:02.607773 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.607364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg" event={"ID":"fe66cc5e-8f69-43eb-a878-08a1626a0ce3","Type":"ContainerDied","Data":"d3f3cf1cea37b1add61c2ba46d7651fd3fec2f4e7f27ed1dac5c1f0bfbe4dcc9"}
Jul 29 06:34:02.609585 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.609565    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerID="55874a8bcfae478655cba71203275ad681e7be1dc875165d3c4d5e3631eb4928" exitCode=0
Jul 29 06:34:02.609680 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.609625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr" event={"ID":"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe","Type":"ContainerDied","Data":"55874a8bcfae478655cba71203275ad681e7be1dc875165d3c4d5e3631eb4928"}
Jul 29 06:34:02.611874 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.611852    2578 generic.go:356] "Generic (PLEG): container finished" podID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerID="44b3a6e0402be8efbf6ef1bf729893cfaefa28f327cefc0455868aba89dc168c" exitCode=0
Jul 29 06:34:02.612002 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.611925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh" event={"ID":"20183204-0d3c-4d21-bdb8-fade07f7d288","Type":"ContainerDied","Data":"44b3a6e0402be8efbf6ef1bf729893cfaefa28f327cefc0455868aba89dc168c"}
Jul 29 06:34:02.613639 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.613620    2578 generic.go:356] "Generic (PLEG): container finished" podID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerID="4d453649823b1daedf00275b69ac8a845b6d6e57397b8411952ef752bc57bad1" exitCode=0
Jul 29 06:34:02.613766 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:02.613697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb" event={"ID":"611af5bb-899b-46ed-89d0-f9c39d08c173","Type":"ContainerDied","Data":"4d453649823b1daedf00275b69ac8a845b6d6e57397b8411952ef752bc57bad1"}
Jul 29 06:34:03.621507 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.621473    2578 generic.go:356] "Generic (PLEG): container finished" podID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerID="9c81aacf8506fd7eede966f215b34836007d997ef0621dbef999f2ba3fb1fd6c" exitCode=0
Jul 29 06:34:03.622013 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.621563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb" event={"ID":"611af5bb-899b-46ed-89d0-f9c39d08c173","Type":"ContainerDied","Data":"9c81aacf8506fd7eede966f215b34836007d997ef0621dbef999f2ba3fb1fd6c"}
Jul 29 06:34:03.781839 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.781814    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:34:03.820097 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.820074    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:03.822911 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.822887    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:34:03.916748 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-277gh\" (UniqueName: \"kubernetes.io/projected/20183204-0d3c-4d21-bdb8-fade07f7d288-kube-api-access-277gh\") pod \"20183204-0d3c-4d21-bdb8-fade07f7d288\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") "
Jul 29 06:34:03.916748 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916683    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggrbn\" (UniqueName: \"kubernetes.io/projected/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-kube-api-access-ggrbn\") pod \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") "
Jul 29 06:34:03.916748 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916730    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-bundle\") pod \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") "
Jul 29 06:34:03.917034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-bundle\") pod \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") "
Jul 29 06:34:03.917034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rnfk\" (UniqueName: \"kubernetes.io/projected/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-kube-api-access-4rnfk\") pod \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") "
Jul 29 06:34:03.917034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-bundle\") pod \"20183204-0d3c-4d21-bdb8-fade07f7d288\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") "
Jul 29 06:34:03.917034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-util\") pod \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\" (UID: \"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe\") "
Jul 29 06:34:03.917034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-util\") pod \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\" (UID: \"fe66cc5e-8f69-43eb-a878-08a1626a0ce3\") "
Jul 29 06:34:03.917034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.916921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-util\") pod \"20183204-0d3c-4d21-bdb8-fade07f7d288\" (UID: \"20183204-0d3c-4d21-bdb8-fade07f7d288\") "
Jul 29 06:34:03.917808 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.917522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-bundle" (OuterVolumeSpecName: "bundle") pod "fe66cc5e-8f69-43eb-a878-08a1626a0ce3" (UID: "fe66cc5e-8f69-43eb-a878-08a1626a0ce3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:03.917808 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.917574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-bundle" (OuterVolumeSpecName: "bundle") pod "20183204-0d3c-4d21-bdb8-fade07f7d288" (UID: "20183204-0d3c-4d21-bdb8-fade07f7d288"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:03.917972 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.917805    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-bundle" (OuterVolumeSpecName: "bundle") pod "f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" (UID: "f0bc4446-7c8d-4e04-80dd-a643c42d6bfe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:03.919328 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.919305    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-kube-api-access-ggrbn" (OuterVolumeSpecName: "kube-api-access-ggrbn") pod "fe66cc5e-8f69-43eb-a878-08a1626a0ce3" (UID: "fe66cc5e-8f69-43eb-a878-08a1626a0ce3"). InnerVolumeSpecName "kube-api-access-ggrbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:03.919415 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.919367    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-kube-api-access-4rnfk" (OuterVolumeSpecName: "kube-api-access-4rnfk") pod "f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" (UID: "f0bc4446-7c8d-4e04-80dd-a643c42d6bfe"). InnerVolumeSpecName "kube-api-access-4rnfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:03.919584 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.919557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20183204-0d3c-4d21-bdb8-fade07f7d288-kube-api-access-277gh" (OuterVolumeSpecName: "kube-api-access-277gh") pod "20183204-0d3c-4d21-bdb8-fade07f7d288" (UID: "20183204-0d3c-4d21-bdb8-fade07f7d288"). InnerVolumeSpecName "kube-api-access-277gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:03.924043 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.924009    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-util" (OuterVolumeSpecName: "util") pod "20183204-0d3c-4d21-bdb8-fade07f7d288" (UID: "20183204-0d3c-4d21-bdb8-fade07f7d288"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:03.924480 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.924456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-util" (OuterVolumeSpecName: "util") pod "f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" (UID: "f0bc4446-7c8d-4e04-80dd-a643c42d6bfe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:03.926513 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:03.926490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-util" (OuterVolumeSpecName: "util") pod "fe66cc5e-8f69-43eb-a878-08a1626a0ce3" (UID: "fe66cc5e-8f69-43eb-a878-08a1626a0ce3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:04.017853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017810    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-277gh\" (UniqueName: \"kubernetes.io/projected/20183204-0d3c-4d21-bdb8-fade07f7d288-kube-api-access-277gh\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.017853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017842    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggrbn\" (UniqueName: \"kubernetes.io/projected/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-kube-api-access-ggrbn\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.017853 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017857    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.018127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017869    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.018127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017920    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rnfk\" (UniqueName: \"kubernetes.io/projected/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-kube-api-access-4rnfk\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.018127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017933    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.018127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017943    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bc4446-7c8d-4e04-80dd-a643c42d6bfe-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.018127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017953    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe66cc5e-8f69-43eb-a878-08a1626a0ce3-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.018127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.017963    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20183204-0d3c-4d21-bdb8-fade07f7d288-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.629229 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.629198    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg"
Jul 29 06:34:04.629637 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.629200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg" event={"ID":"fe66cc5e-8f69-43eb-a878-08a1626a0ce3","Type":"ContainerDied","Data":"a17796d74a89936705ad89cd23dc848526efa154e9987effd5844c30a10c65b0"}
Jul 29 06:34:04.629637 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.629333    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a17796d74a89936705ad89cd23dc848526efa154e9987effd5844c30a10c65b0"
Jul 29 06:34:04.631119 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.631097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr" event={"ID":"f0bc4446-7c8d-4e04-80dd-a643c42d6bfe","Type":"ContainerDied","Data":"f421050554b9166ce123a038f27c2e8a54af1fdfa1f1dd4328fac4ab72da1fb5"}
Jul 29 06:34:04.631246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.631119    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr"
Jul 29 06:34:04.631246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.631131    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f421050554b9166ce123a038f27c2e8a54af1fdfa1f1dd4328fac4ab72da1fb5"
Jul 29 06:34:04.632942 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.632913    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh"
Jul 29 06:34:04.632942 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.632927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh" event={"ID":"20183204-0d3c-4d21-bdb8-fade07f7d288","Type":"ContainerDied","Data":"563e463444290b222222747ad3c526633f20fe336da809829fa690261ba3802c"}
Jul 29 06:34:04.633085 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.632961    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="563e463444290b222222747ad3c526633f20fe336da809829fa690261ba3802c"
Jul 29 06:34:04.755098 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.755073    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:04.825253 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.825211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-util\") pod \"611af5bb-899b-46ed-89d0-f9c39d08c173\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") "
Jul 29 06:34:04.825477 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.825306    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqh8s\" (UniqueName: \"kubernetes.io/projected/611af5bb-899b-46ed-89d0-f9c39d08c173-kube-api-access-jqh8s\") pod \"611af5bb-899b-46ed-89d0-f9c39d08c173\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") "
Jul 29 06:34:04.825477 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.825349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-bundle\") pod \"611af5bb-899b-46ed-89d0-f9c39d08c173\" (UID: \"611af5bb-899b-46ed-89d0-f9c39d08c173\") "
Jul 29 06:34:04.826006 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.825977    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-bundle" (OuterVolumeSpecName: "bundle") pod "611af5bb-899b-46ed-89d0-f9c39d08c173" (UID: "611af5bb-899b-46ed-89d0-f9c39d08c173"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:04.827562 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.827530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611af5bb-899b-46ed-89d0-f9c39d08c173-kube-api-access-jqh8s" (OuterVolumeSpecName: "kube-api-access-jqh8s") pod "611af5bb-899b-46ed-89d0-f9c39d08c173" (UID: "611af5bb-899b-46ed-89d0-f9c39d08c173"). InnerVolumeSpecName "kube-api-access-jqh8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:04.830613 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.830590    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-util" (OuterVolumeSpecName: "util") pod "611af5bb-899b-46ed-89d0-f9c39d08c173" (UID: "611af5bb-899b-46ed-89d0-f9c39d08c173"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:04.926318 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.926284    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqh8s\" (UniqueName: \"kubernetes.io/projected/611af5bb-899b-46ed-89d0-f9c39d08c173-kube-api-access-jqh8s\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.926318 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.926311    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:04.926318 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:04.926321    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611af5bb-899b-46ed-89d0-f9c39d08c173-util\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:05.639764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:05.639729    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb"
Jul 29 06:34:05.639764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:05.639742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb" event={"ID":"611af5bb-899b-46ed-89d0-f9c39d08c173","Type":"ContainerDied","Data":"ff34994a4201670137da55ca44e87f7495a7e183befb7bfe80463e7b5b8c4703"}
Jul 29 06:34:05.640265 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:05.639814    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff34994a4201670137da55ca44e87f7495a7e183befb7bfe80463e7b5b8c4703"
Jul 29 06:34:22.199480 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199444    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"]
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199784    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199795    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199804    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199809    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199821    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="extract"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199828    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="extract"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199834    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="util"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199840    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="util"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199854    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199860    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199867    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199872    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="pull"
Jul 29 06:34:22.199869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199877    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199881    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199888    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199892    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199898    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="util"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199903    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="util"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199910    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199915    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199921    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="util"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199925    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="util"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199930    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="util"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199935    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="util"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.199992    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0bc4446-7c8d-4e04-80dd-a643c42d6bfe" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.200000    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe66cc5e-8f69-43eb-a878-08a1626a0ce3" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.200006    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="611af5bb-899b-46ed-89d0-f9c39d08c173" containerName="extract"
Jul 29 06:34:22.200228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.200013    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="20183204-0d3c-4d21-bdb8-fade07f7d288" containerName="extract"
Jul 29 06:34:22.202885 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.202870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:22.205490 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.205467    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 06:34:22.205589 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.205498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 06:34:22.205589 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.205467    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 06:34:22.206512 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.206498    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-v8kvv\""
Jul 29 06:34:22.214570 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.214549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"]
Jul 29 06:34:22.383295 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.383262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lpl7\" (UniqueName: \"kubernetes.io/projected/e11fc148-5d3a-47d8-89a6-852f40854fc6-kube-api-access-7lpl7\") pod \"dns-operator-controller-manager-864dd78c4c-tz84h\" (UID: \"e11fc148-5d3a-47d8-89a6-852f40854fc6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:22.484692 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.484614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lpl7\" (UniqueName: \"kubernetes.io/projected/e11fc148-5d3a-47d8-89a6-852f40854fc6-kube-api-access-7lpl7\") pod \"dns-operator-controller-manager-864dd78c4c-tz84h\" (UID: \"e11fc148-5d3a-47d8-89a6-852f40854fc6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:22.492787 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.492760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lpl7\" (UniqueName: \"kubernetes.io/projected/e11fc148-5d3a-47d8-89a6-852f40854fc6-kube-api-access-7lpl7\") pod \"dns-operator-controller-manager-864dd78c4c-tz84h\" (UID: \"e11fc148-5d3a-47d8-89a6-852f40854fc6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:22.512563 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.512534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:22.661127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.661104    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"]
Jul 29 06:34:22.663583 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:22.663558    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11fc148_5d3a_47d8_89a6_852f40854fc6.slice/crio-cdf66479cea2a5fec98d256d6f95d39579456c949c74a683ffa3a7e364b0f18d WatchSource:0}: Error finding container cdf66479cea2a5fec98d256d6f95d39579456c949c74a683ffa3a7e364b0f18d: Status 404 returned error can't find the container with id cdf66479cea2a5fec98d256d6f95d39579456c949c74a683ffa3a7e364b0f18d
Jul 29 06:34:22.728004 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:22.727972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h" event={"ID":"e11fc148-5d3a-47d8-89a6-852f40854fc6","Type":"ContainerStarted","Data":"cdf66479cea2a5fec98d256d6f95d39579456c949c74a683ffa3a7e364b0f18d"}
Jul 29 06:34:24.742575 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:24.742535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h" event={"ID":"e11fc148-5d3a-47d8-89a6-852f40854fc6","Type":"ContainerStarted","Data":"f7f8350b6521caef849ccbfc93fb9376d490ccccaef051aeb9b989723a81618e"}
Jul 29 06:34:24.742952 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:24.742625    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:24.762191 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:24.762148    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h" podStartSLOduration=0.885404135 podStartE2EDuration="2.762132137s" totalImagesPullingTime="1.876728002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:34:24.760799086 +0000 UTC m=+706.396390878" watchObservedRunningTime="2026-07-29 06:34:24.762132137 +0000 UTC m=+706.397723927"
Jul 29 06:34:26.693779 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:26.693734    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66489b9d84-fl8fz" podUID="14a23bc9-c4ff-4a09-9052-c454bf5924ba" containerName="console" containerID="cri-o://d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00" gracePeriod=15
Jul 29 06:34:26.947563 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:26.947501    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:34:27.022908 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.022875    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-config\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023068 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.022933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-oauth-config\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023068 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.022960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq45b\" (UniqueName: \"kubernetes.io/projected/14a23bc9-c4ff-4a09-9052-c454bf5924ba-kube-api-access-dq45b\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023173 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023078    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-service-ca\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023173 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-oauth-serving-cert\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023286 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-trusted-ca-bundle\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023286 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-serving-cert\") pod \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\" (UID: \"14a23bc9-c4ff-4a09-9052-c454bf5924ba\") "
Jul 29 06:34:27.023390 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023257    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-config" (OuterVolumeSpecName: "console-config") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:34:27.023927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023529    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:34:27.023927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023542    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:34:27.023927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023868    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.023927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023888    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.023927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023901    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-oauth-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.023927 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.023892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:34:27.025278 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.025254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:34:27.025371 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.025274    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 06:34:27.025371 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.025319    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a23bc9-c4ff-4a09-9052-c454bf5924ba-kube-api-access-dq45b" (OuterVolumeSpecName: "kube-api-access-dq45b") pod "14a23bc9-c4ff-4a09-9052-c454bf5924ba" (UID: "14a23bc9-c4ff-4a09-9052-c454bf5924ba"). InnerVolumeSpecName "kube-api-access-dq45b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:27.124900 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.124858    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14a23bc9-c4ff-4a09-9052-c454bf5924ba-trusted-ca-bundle\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.124900 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.124890    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-serving-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.124900 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.124905    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14a23bc9-c4ff-4a09-9052-c454bf5924ba-console-oauth-config\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.125130 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.124917    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq45b\" (UniqueName: \"kubernetes.io/projected/14a23bc9-c4ff-4a09-9052-c454bf5924ba-kube-api-access-dq45b\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:27.227731 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.227635    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"]
Jul 29 06:34:27.228008 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.227995    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a23bc9-c4ff-4a09-9052-c454bf5924ba" containerName="console"
Jul 29 06:34:27.228056 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.228010    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a23bc9-c4ff-4a09-9052-c454bf5924ba" containerName="console"
Jul 29 06:34:27.228092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.228077    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a23bc9-c4ff-4a09-9052-c454bf5924ba" containerName="console"
Jul 29 06:34:27.230858 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.230843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.233160 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.233142    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nz2bt\""
Jul 29 06:34:27.243275 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.243253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"]
Jul 29 06:34:27.326868 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.326835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.326868 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.326873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t7s9\" (UniqueName: \"kubernetes.io/projected/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-kube-api-access-2t7s9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.427275 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.427228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.427275 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.427278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t7s9\" (UniqueName: \"kubernetes.io/projected/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-kube-api-access-2t7s9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.427647 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.427621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.442466 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.442441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t7s9\" (UniqueName: \"kubernetes.io/projected/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-kube-api-access-2t7s9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.541649 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.541564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:27.676694 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.676672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"]
Jul 29 06:34:27.678242 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:27.678218    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53194a1f_e6aa_491a_8c92_e93b7d8fe29d.slice/crio-67963feb8ad6e775f4cc92e38b7f5612808d995373694ee96b27ac5a2ed5fa4e WatchSource:0}: Error finding container 67963feb8ad6e775f4cc92e38b7f5612808d995373694ee96b27ac5a2ed5fa4e: Status 404 returned error can't find the container with id 67963feb8ad6e775f4cc92e38b7f5612808d995373694ee96b27ac5a2ed5fa4e
Jul 29 06:34:27.760448 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.760413    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp" event={"ID":"53194a1f-e6aa-491a-8c92-e93b7d8fe29d","Type":"ContainerStarted","Data":"67963feb8ad6e775f4cc92e38b7f5612808d995373694ee96b27ac5a2ed5fa4e"}
Jul 29 06:34:27.761680 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.761656    2578 generic.go:356] "Generic (PLEG): container finished" podID="14a23bc9-c4ff-4a09-9052-c454bf5924ba" containerID="d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00" exitCode=0
Jul 29 06:34:27.761794 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.761701    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66489b9d84-fl8fz"
Jul 29 06:34:27.761794 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.761757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66489b9d84-fl8fz" event={"ID":"14a23bc9-c4ff-4a09-9052-c454bf5924ba","Type":"ContainerDied","Data":"d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00"}
Jul 29 06:34:27.761856 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.761803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66489b9d84-fl8fz" event={"ID":"14a23bc9-c4ff-4a09-9052-c454bf5924ba","Type":"ContainerDied","Data":"b8844938a67b20589d427c0ccf095ef43763c579b7cf90dacdae2be6dde0819b"}
Jul 29 06:34:27.761856 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.761832    2578 scope.go:117] "RemoveContainer" containerID="d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00"
Jul 29 06:34:27.771284 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.771266    2578 scope.go:117] "RemoveContainer" containerID="d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00"
Jul 29 06:34:27.771555 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:27.771539    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00\": container with ID starting with d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00 not found: ID does not exist" containerID="d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00"
Jul 29 06:34:27.771607 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.771564    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00"} err="failed to get container status \"d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00\": rpc error: code = NotFound desc = could not find container \"d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00\": container with ID starting with d9c1a75acbb9fe2b8e377d2d3551a49fb4441b5f23115fca86c936c6f0eedc00 not found: ID does not exist"
Jul 29 06:34:27.786599 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.786574    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66489b9d84-fl8fz"]
Jul 29 06:34:27.789983 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:27.789656    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66489b9d84-fl8fz"]
Jul 29 06:34:28.904897 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:28.904867    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a23bc9-c4ff-4a09-9052-c454bf5924ba" path="/var/lib/kubelet/pods/14a23bc9-c4ff-4a09-9052-c454bf5924ba/volumes"
Jul 29 06:34:33.801454 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:33.801349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp" event={"ID":"53194a1f-e6aa-491a-8c92-e93b7d8fe29d","Type":"ContainerStarted","Data":"312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d"}
Jul 29 06:34:33.801932 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:33.801484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:33.819076 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:33.819026    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp" podStartSLOduration=1.037787901 podStartE2EDuration="6.819010973s" totalImagesPullingTime="5.781223072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:34:33.818010134 +0000 UTC m=+715.453601939" watchObservedRunningTime="2026-07-29 06:34:33.819010973 +0000 UTC m=+715.454602763"
Jul 29 06:34:35.749734 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:35.749679    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tz84h"
Jul 29 06:34:44.808447 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:44.808417    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:45.743797 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.743762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"]
Jul 29 06:34:45.748554 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.748527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:45.758779 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.758756    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"]
Jul 29 06:34:45.797789 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.797760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/609f4e68-ed51-4e6d-9e3d-825ae7872932-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:45.797950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.797794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckk2\" (UniqueName: \"kubernetes.io/projected/609f4e68-ed51-4e6d-9e3d-825ae7872932-kube-api-access-9ckk2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:45.898645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.898610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/609f4e68-ed51-4e6d-9e3d-825ae7872932-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:45.899114 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.898654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckk2\" (UniqueName: \"kubernetes.io/projected/609f4e68-ed51-4e6d-9e3d-825ae7872932-kube-api-access-9ckk2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:45.899114 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.899065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/609f4e68-ed51-4e6d-9e3d-825ae7872932-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:45.906957 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:45.906934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckk2\" (UniqueName: \"kubernetes.io/projected/609f4e68-ed51-4e6d-9e3d-825ae7872932-kube-api-access-9ckk2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:46.059656 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.059567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:46.201982 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.201951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"]
Jul 29 06:34:46.203621 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:46.203598    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609f4e68_ed51_4e6d_9e3d_825ae7872932.slice/crio-dd022c127f3ad197444705ae7c36afd0b84e7579d2f1e1382c5c1df53aeff205 WatchSource:0}: Error finding container dd022c127f3ad197444705ae7c36afd0b84e7579d2f1e1382c5c1df53aeff205: Status 404 returned error can't find the container with id dd022c127f3ad197444705ae7c36afd0b84e7579d2f1e1382c5c1df53aeff205
Jul 29 06:34:46.494879 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.494837    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"]
Jul 29 06:34:46.503553 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.503528    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"]
Jul 29 06:34:46.527041 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.527013    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"]
Jul 29 06:34:46.527240 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.527199    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" containerName="manager" containerID="cri-o://312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d" gracePeriod=2
Jul 29 06:34:46.542697 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.542672    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"]
Jul 29 06:34:46.543173 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.543157    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" containerName="manager"
Jul 29 06:34:46.543225 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.543175    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" containerName="manager"
Jul 29 06:34:46.543262 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.543241    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" containerName="manager"
Jul 29 06:34:46.546455 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.546433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.548314 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.548288    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"]
Jul 29 06:34:46.564105 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.564066    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.564323 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.564301    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"]
Jul 29 06:34:46.564833 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.564816    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" containerName="manager"
Jul 29 06:34:46.564911 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.564836    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" containerName="manager"
Jul 29 06:34:46.565000 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.564987    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" containerName="manager"
Jul 29 06:34:46.568480 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.568460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.571258 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.571230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"]
Jul 29 06:34:46.585978 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.585947    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"]
Jul 29 06:34:46.598277 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.598241    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.604052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.604028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42ls\" (UniqueName: \"kubernetes.io/projected/f2644b2b-6cfd-4b30-9128-83725b68ecf9-kube-api-access-w42ls\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w5jvx\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.604169 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.604061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2644b2b-6cfd-4b30-9128-83725b68ecf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w5jvx\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.627152 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.627111    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.705268 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.705227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42ls\" (UniqueName: \"kubernetes.io/projected/f2644b2b-6cfd-4b30-9128-83725b68ecf9-kube-api-access-w42ls\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w5jvx\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.705437 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.705289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2644b2b-6cfd-4b30-9128-83725b68ecf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w5jvx\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.705437 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.705405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69825cb4-7630-49fc-b436-5399bf02b3d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2vr9w\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.705557 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.705441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7x7t\" (UniqueName: \"kubernetes.io/projected/69825cb4-7630-49fc-b436-5399bf02b3d5-kube-api-access-h7x7t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2vr9w\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.705862 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.705774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2644b2b-6cfd-4b30-9128-83725b68ecf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w5jvx\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.714147 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.714126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42ls\" (UniqueName: \"kubernetes.io/projected/f2644b2b-6cfd-4b30-9128-83725b68ecf9-kube-api-access-w42ls\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w5jvx\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.764160 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.764136    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.766457 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.766431    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.806948 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.806916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69825cb4-7630-49fc-b436-5399bf02b3d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2vr9w\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.806948 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.806954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7x7t\" (UniqueName: \"kubernetes.io/projected/69825cb4-7630-49fc-b436-5399bf02b3d5-kube-api-access-h7x7t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2vr9w\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.807329 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.807309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69825cb4-7630-49fc-b436-5399bf02b3d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2vr9w\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.815322 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.815299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7x7t\" (UniqueName: \"kubernetes.io/projected/69825cb4-7630-49fc-b436-5399bf02b3d5-kube-api-access-h7x7t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2vr9w\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.874550 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.874515    2578 generic.go:356] "Generic (PLEG): container finished" podID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" containerID="312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d" exitCode=0
Jul 29 06:34:46.874550 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.874557    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.874809 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.874620    2578 scope.go:117] "RemoveContainer" containerID="312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d"
Jul 29 06:34:46.876748 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.876702    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q" container="manager"
Jul 29 06:34:46.876961 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.876927    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.878947 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.878919    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hbnrp\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbnrp"
Jul 29 06:34:46.880972 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.880940    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:46.885013 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.884965    2578 scope.go:117] "RemoveContainer" containerID="312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d"
Jul 29 06:34:46.885285 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:46.885267    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d\": container with ID starting with 312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d not found: ID does not exist" containerID="312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d"
Jul 29 06:34:46.885346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.885294    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d"} err="failed to get container status \"312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d\": rpc error: code = NotFound desc = could not find container \"312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d\": container with ID starting with 312e459e4fc3a8284115b157b40be1cedd3f6aa6daf2426ed4388790bd6f426d not found: ID does not exist"
Jul 29 06:34:46.895495 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.895475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:46.902352 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.902328    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:46.907886 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.907870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-extensions-socket-volume\") pod \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") "
Jul 29 06:34:46.908006 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.907964    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t7s9\" (UniqueName: \"kubernetes.io/projected/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-kube-api-access-2t7s9\") pod \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\" (UID: \"53194a1f-e6aa-491a-8c92-e93b7d8fe29d\") "
Jul 29 06:34:46.908306 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.908278    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "53194a1f-e6aa-491a-8c92-e93b7d8fe29d" (UID: "53194a1f-e6aa-491a-8c92-e93b7d8fe29d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:46.910126 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:46.910094    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-kube-api-access-2t7s9" (OuterVolumeSpecName: "kube-api-access-2t7s9") pod "53194a1f-e6aa-491a-8c92-e93b7d8fe29d" (UID: "53194a1f-e6aa-491a-8c92-e93b7d8fe29d"). InnerVolumeSpecName "kube-api-access-2t7s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:47.009444 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.009334    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-extensions-socket-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:47.009444 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.009365    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t7s9\" (UniqueName: \"kubernetes.io/projected/53194a1f-e6aa-491a-8c92-e93b7d8fe29d-kube-api-access-2t7s9\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:47.048375 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.048343    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"]
Jul 29 06:34:47.052218 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:47.052188    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2644b2b_6cfd_4b30_9128_83725b68ecf9.slice/crio-76f37d9a7eef87e54092f5558e794a38ccc15d4732d716e0f33838ba025a2092 WatchSource:0}: Error finding container 76f37d9a7eef87e54092f5558e794a38ccc15d4732d716e0f33838ba025a2092: Status 404 returned error can't find the container with id 76f37d9a7eef87e54092f5558e794a38ccc15d4732d716e0f33838ba025a2092
Jul 29 06:34:47.069756 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.069700    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"]
Jul 29 06:34:47.072002 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:47.071980    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69825cb4_7630_49fc_b436_5399bf02b3d5.slice/crio-19bdc542a0c12a73dbd4b0471c6f661ee815b443227e83315201ce0bfaa794c7 WatchSource:0}: Error finding container 19bdc542a0c12a73dbd4b0471c6f661ee815b443227e83315201ce0bfaa794c7: Status 404 returned error can't find the container with id 19bdc542a0c12a73dbd4b0471c6f661ee815b443227e83315201ce0bfaa794c7
Jul 29 06:34:47.885054 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.884602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w" event={"ID":"69825cb4-7630-49fc-b436-5399bf02b3d5","Type":"ContainerStarted","Data":"6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce"}
Jul 29 06:34:47.885266 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.885100    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:47.885266 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.885142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w" event={"ID":"69825cb4-7630-49fc-b436-5399bf02b3d5","Type":"ContainerStarted","Data":"19bdc542a0c12a73dbd4b0471c6f661ee815b443227e83315201ce0bfaa794c7"}
Jul 29 06:34:47.891721 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.891641    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" containerName="manager" containerID="cri-o://d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d" gracePeriod=2
Jul 29 06:34:47.893898 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.893867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx" event={"ID":"f2644b2b-6cfd-4b30-9128-83725b68ecf9","Type":"ContainerStarted","Data":"e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5"}
Jul 29 06:34:47.894019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.893948    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:47.894019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.893967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx" event={"ID":"f2644b2b-6cfd-4b30-9128-83725b68ecf9","Type":"ContainerStarted","Data":"76f37d9a7eef87e54092f5558e794a38ccc15d4732d716e0f33838ba025a2092"}
Jul 29 06:34:47.905541 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.905495    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w" podStartSLOduration=1.905480335 podStartE2EDuration="1.905480335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:34:47.903227791 +0000 UTC m=+729.538819607" watchObservedRunningTime="2026-07-29 06:34:47.905480335 +0000 UTC m=+729.541072127"
Jul 29 06:34:47.922029 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:47.921989    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx" podStartSLOduration=1.921974842 podStartE2EDuration="1.921974842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:34:47.920257968 +0000 UTC m=+729.555849760" watchObservedRunningTime="2026-07-29 06:34:47.921974842 +0000 UTC m=+729.557566702"
Jul 29 06:34:48.139852 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.139789    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:48.142585 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:48.142559    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:48.220664 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.220630    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ckk2\" (UniqueName: \"kubernetes.io/projected/609f4e68-ed51-4e6d-9e3d-825ae7872932-kube-api-access-9ckk2\") pod \"609f4e68-ed51-4e6d-9e3d-825ae7872932\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") "
Jul 29 06:34:48.220865 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.220779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/609f4e68-ed51-4e6d-9e3d-825ae7872932-extensions-socket-volume\") pod \"609f4e68-ed51-4e6d-9e3d-825ae7872932\" (UID: \"609f4e68-ed51-4e6d-9e3d-825ae7872932\") "
Jul 29 06:34:48.221120 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.221092    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/609f4e68-ed51-4e6d-9e3d-825ae7872932-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "609f4e68-ed51-4e6d-9e3d-825ae7872932" (UID: "609f4e68-ed51-4e6d-9e3d-825ae7872932"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:48.222939 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.222911    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/609f4e68-ed51-4e6d-9e3d-825ae7872932-kube-api-access-9ckk2" (OuterVolumeSpecName: "kube-api-access-9ckk2") pod "609f4e68-ed51-4e6d-9e3d-825ae7872932" (UID: "609f4e68-ed51-4e6d-9e3d-825ae7872932"). InnerVolumeSpecName "kube-api-access-9ckk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:48.321568 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.321532    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ckk2\" (UniqueName: \"kubernetes.io/projected/609f4e68-ed51-4e6d-9e3d-825ae7872932-kube-api-access-9ckk2\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:48.321568 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.321560    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/609f4e68-ed51-4e6d-9e3d-825ae7872932-extensions-socket-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:48.900878 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.900844    2578 generic.go:356] "Generic (PLEG): container finished" podID="609f4e68-ed51-4e6d-9e3d-825ae7872932" containerID="d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d" exitCode=0
Jul 29 06:34:48.902327 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.902305    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:48.904910 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:48.904878    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:48.905682 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.905662    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53194a1f-e6aa-491a-8c92-e93b7d8fe29d" path="/var/lib/kubelet/pods/53194a1f-e6aa-491a-8c92-e93b7d8fe29d/volumes"
Jul 29 06:34:48.906028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.906014    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" path="/var/lib/kubelet/pods/609f4e68-ed51-4e6d-9e3d-825ae7872932/volumes"
Jul 29 06:34:48.906309 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.906298    2578 scope.go:117] "RemoveContainer" containerID="d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d"
Jul 29 06:34:48.907091 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:48.907051    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sl59q\" is forbidden: User \"system:node:ip-10-0-133-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-7.ec2.internal' and this object" podUID="609f4e68-ed51-4e6d-9e3d-825ae7872932" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sl59q"
Jul 29 06:34:48.920532 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.920512    2578 scope.go:117] "RemoveContainer" containerID="d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d"
Jul 29 06:34:48.920808 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:48.920790    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d\": container with ID starting with d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d not found: ID does not exist" containerID="d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d"
Jul 29 06:34:48.920868 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:48.920818    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d"} err="failed to get container status \"d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d\": rpc error: code = NotFound desc = could not find container \"d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d\": container with ID starting with d6d6a88f12a27f04579a8044fc3243829199e8e8350ce900522a847e2383bf4d not found: ID does not exist"
Jul 29 06:34:58.904675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:58.904646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:34:58.905143 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:58.904729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:58.967438 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:58.967408    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"]
Jul 29 06:34:58.967678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:58.967654    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w" podUID="69825cb4-7630-49fc-b436-5399bf02b3d5" containerName="manager" containerID="cri-o://6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce" gracePeriod=10
Jul 29 06:34:59.202159 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.202127    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"]
Jul 29 06:34:59.224938 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.224908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"]
Jul 29 06:34:59.225107 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.225032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.241286 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.241263    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:59.318540 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.318498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7x7t\" (UniqueName: \"kubernetes.io/projected/69825cb4-7630-49fc-b436-5399bf02b3d5-kube-api-access-h7x7t\") pod \"69825cb4-7630-49fc-b436-5399bf02b3d5\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") "
Jul 29 06:34:59.318691 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.318578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69825cb4-7630-49fc-b436-5399bf02b3d5-extensions-socket-volume\") pod \"69825cb4-7630-49fc-b436-5399bf02b3d5\" (UID: \"69825cb4-7630-49fc-b436-5399bf02b3d5\") "
Jul 29 06:34:59.318783 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.318764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be1fe4e-9817-4302-8719-a2ef07b41ac8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fdp7c\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.318831 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.318795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srcps\" (UniqueName: \"kubernetes.io/projected/6be1fe4e-9817-4302-8719-a2ef07b41ac8-kube-api-access-srcps\") pod \"kuadrant-operator-controller-manager-86878c769f-fdp7c\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.319013 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.318979    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69825cb4-7630-49fc-b436-5399bf02b3d5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "69825cb4-7630-49fc-b436-5399bf02b3d5" (UID: "69825cb4-7630-49fc-b436-5399bf02b3d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:34:59.320747 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.320728    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69825cb4-7630-49fc-b436-5399bf02b3d5-kube-api-access-h7x7t" (OuterVolumeSpecName: "kube-api-access-h7x7t") pod "69825cb4-7630-49fc-b436-5399bf02b3d5" (UID: "69825cb4-7630-49fc-b436-5399bf02b3d5"). InnerVolumeSpecName "kube-api-access-h7x7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:34:59.420418 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.420314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be1fe4e-9817-4302-8719-a2ef07b41ac8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fdp7c\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.420418 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.420361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srcps\" (UniqueName: \"kubernetes.io/projected/6be1fe4e-9817-4302-8719-a2ef07b41ac8-kube-api-access-srcps\") pod \"kuadrant-operator-controller-manager-86878c769f-fdp7c\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.420625 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.420468    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69825cb4-7630-49fc-b436-5399bf02b3d5-extensions-socket-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:59.420625 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.420482    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7x7t\" (UniqueName: \"kubernetes.io/projected/69825cb4-7630-49fc-b436-5399bf02b3d5-kube-api-access-h7x7t\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:34:59.420829 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.420805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be1fe4e-9817-4302-8719-a2ef07b41ac8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fdp7c\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.429152 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.429132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srcps\" (UniqueName: \"kubernetes.io/projected/6be1fe4e-9817-4302-8719-a2ef07b41ac8-kube-api-access-srcps\") pod \"kuadrant-operator-controller-manager-86878c769f-fdp7c\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.537387 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.537349    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.680861 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.680835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"]
Jul 29 06:34:59.681994 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:34:59.681968    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be1fe4e_9817_4302_8719_a2ef07b41ac8.slice/crio-97c194afb12a3ee6fa4eff73d71cee14666ab6288c7d55b6dd7cb247c78c141a WatchSource:0}: Error finding container 97c194afb12a3ee6fa4eff73d71cee14666ab6288c7d55b6dd7cb247c78c141a: Status 404 returned error can't find the container with id 97c194afb12a3ee6fa4eff73d71cee14666ab6288c7d55b6dd7cb247c78c141a
Jul 29 06:34:59.966824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.966725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c" event={"ID":"6be1fe4e-9817-4302-8719-a2ef07b41ac8","Type":"ContainerStarted","Data":"083bcb759ca32ee877820db539e40b593b39732481f90996a5800640b4d74e25"}
Jul 29 06:34:59.966824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.966794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c" event={"ID":"6be1fe4e-9817-4302-8719-a2ef07b41ac8","Type":"ContainerStarted","Data":"97c194afb12a3ee6fa4eff73d71cee14666ab6288c7d55b6dd7cb247c78c141a"}
Jul 29 06:34:59.967375 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.966918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:34:59.968091 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.968069    2578 generic.go:356] "Generic (PLEG): container finished" podID="69825cb4-7630-49fc-b436-5399bf02b3d5" containerID="6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce" exitCode=0
Jul 29 06:34:59.968198 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.968102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w" event={"ID":"69825cb4-7630-49fc-b436-5399bf02b3d5","Type":"ContainerDied","Data":"6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce"}
Jul 29 06:34:59.968198 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.968120    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"
Jul 29 06:34:59.968198 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.968131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w" event={"ID":"69825cb4-7630-49fc-b436-5399bf02b3d5","Type":"ContainerDied","Data":"19bdc542a0c12a73dbd4b0471c6f661ee815b443227e83315201ce0bfaa794c7"}
Jul 29 06:34:59.968198 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.968154    2578 scope.go:117] "RemoveContainer" containerID="6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce"
Jul 29 06:34:59.978046 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.978028    2578 scope.go:117] "RemoveContainer" containerID="6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce"
Jul 29 06:34:59.978316 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:34:59.978297    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce\": container with ID starting with 6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce not found: ID does not exist" containerID="6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce"
Jul 29 06:34:59.978386 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.978324    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce"} err="failed to get container status \"6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce\": rpc error: code = NotFound desc = could not find container \"6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce\": container with ID starting with 6ec0f00fce3b63990ef4808f39c4e7fa3cc5dcb3ab228b86ac913a3cea5c3cce not found: ID does not exist"
Jul 29 06:34:59.989692 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.989633    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c" podStartSLOduration=0.989619209 podStartE2EDuration="989.619209ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:34:59.986892466 +0000 UTC m=+741.622484274" watchObservedRunningTime="2026-07-29 06:34:59.989619209 +0000 UTC m=+741.625210999"
Jul 29 06:34:59.999649 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:34:59.999624    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"]
Jul 29 06:35:00.003588 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:00.003570    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2vr9w"]
Jul 29 06:35:00.904369 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:00.904334    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69825cb4-7630-49fc-b436-5399bf02b3d5" path="/var/lib/kubelet/pods/69825cb4-7630-49fc-b436-5399bf02b3d5/volumes"
Jul 29 06:35:10.977064 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:10.977028    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:35:11.021946 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.021908    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"]
Jul 29 06:35:11.022187 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.022160    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx" podUID="f2644b2b-6cfd-4b30-9128-83725b68ecf9" containerName="manager" containerID="cri-o://e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5" gracePeriod=10
Jul 29 06:35:11.277029 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.277007    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:35:11.425926 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.425884    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w42ls\" (UniqueName: \"kubernetes.io/projected/f2644b2b-6cfd-4b30-9128-83725b68ecf9-kube-api-access-w42ls\") pod \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") "
Jul 29 06:35:11.425926 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.425930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2644b2b-6cfd-4b30-9128-83725b68ecf9-extensions-socket-volume\") pod \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\" (UID: \"f2644b2b-6cfd-4b30-9128-83725b68ecf9\") "
Jul 29 06:35:11.426339 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.426314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2644b2b-6cfd-4b30-9128-83725b68ecf9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2644b2b-6cfd-4b30-9128-83725b68ecf9" (UID: "f2644b2b-6cfd-4b30-9128-83725b68ecf9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:35:11.428200 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.428177    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2644b2b-6cfd-4b30-9128-83725b68ecf9-kube-api-access-w42ls" (OuterVolumeSpecName: "kube-api-access-w42ls") pod "f2644b2b-6cfd-4b30-9128-83725b68ecf9" (UID: "f2644b2b-6cfd-4b30-9128-83725b68ecf9"). InnerVolumeSpecName "kube-api-access-w42ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:35:11.526917 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.526821    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w42ls\" (UniqueName: \"kubernetes.io/projected/f2644b2b-6cfd-4b30-9128-83725b68ecf9-kube-api-access-w42ls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:35:11.526917 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:11.526857    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2644b2b-6cfd-4b30-9128-83725b68ecf9-extensions-socket-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:35:12.041671 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.041634    2578 generic.go:356] "Generic (PLEG): container finished" podID="f2644b2b-6cfd-4b30-9128-83725b68ecf9" containerID="e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5" exitCode=0
Jul 29 06:35:12.042092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.041681    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"
Jul 29 06:35:12.042092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.041739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx" event={"ID":"f2644b2b-6cfd-4b30-9128-83725b68ecf9","Type":"ContainerDied","Data":"e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5"}
Jul 29 06:35:12.042092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.041792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx" event={"ID":"f2644b2b-6cfd-4b30-9128-83725b68ecf9","Type":"ContainerDied","Data":"76f37d9a7eef87e54092f5558e794a38ccc15d4732d716e0f33838ba025a2092"}
Jul 29 06:35:12.042092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.041814    2578 scope.go:117] "RemoveContainer" containerID="e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5"
Jul 29 06:35:12.051529 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.051514    2578 scope.go:117] "RemoveContainer" containerID="e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5"
Jul 29 06:35:12.051814 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:35:12.051794    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5\": container with ID starting with e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5 not found: ID does not exist" containerID="e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5"
Jul 29 06:35:12.051863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.051823    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5"} err="failed to get container status \"e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5\": rpc error: code = NotFound desc = could not find container \"e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5\": container with ID starting with e92288163610c51dbdc79595db1701dd1eb21c7bd34573616d313d4af856d1c5 not found: ID does not exist"
Jul 29 06:35:12.063970 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.063947    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"]
Jul 29 06:35:12.069695 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.069673    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w5jvx"]
Jul 29 06:35:12.905021 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:12.904992    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2644b2b-6cfd-4b30-9128-83725b68ecf9" path="/var/lib/kubelet/pods/f2644b2b-6cfd-4b30-9128-83725b68ecf9/volumes"
Jul 29 06:35:29.374250 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374213    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:35:29.374675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374604    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2644b2b-6cfd-4b30-9128-83725b68ecf9" containerName="manager"
Jul 29 06:35:29.374675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374615    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2644b2b-6cfd-4b30-9128-83725b68ecf9" containerName="manager"
Jul 29 06:35:29.374675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374638    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69825cb4-7630-49fc-b436-5399bf02b3d5" containerName="manager"
Jul 29 06:35:29.374675 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374643    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69825cb4-7630-49fc-b436-5399bf02b3d5" containerName="manager"
Jul 29 06:35:29.374920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374698    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="69825cb4-7630-49fc-b436-5399bf02b3d5" containerName="manager"
Jul 29 06:35:29.374920 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.374723    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2644b2b-6cfd-4b30-9128-83725b68ecf9" containerName="manager"
Jul 29 06:35:29.378343 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.378324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.380694 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.380671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 06:35:29.380788 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.380697    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6llvq\""
Jul 29 06:35:29.384937 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.384915    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:35:29.411012 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.410972    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:35:29.466942 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.466903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-984kg\" (UniqueName: \"kubernetes.io/projected/04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c-kube-api-access-984kg\") pod \"limitador-limitador-54d6d988d5-qkztl\" (UID: \"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.467129 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.466951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c-config-file\") pod \"limitador-limitador-54d6d988d5-qkztl\" (UID: \"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.567567 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.567532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c-config-file\") pod \"limitador-limitador-54d6d988d5-qkztl\" (UID: \"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.567803 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.567626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-984kg\" (UniqueName: \"kubernetes.io/projected/04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c-kube-api-access-984kg\") pod \"limitador-limitador-54d6d988d5-qkztl\" (UID: \"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.568246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.568221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c-config-file\") pod \"limitador-limitador-54d6d988d5-qkztl\" (UID: \"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.574989 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.574965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-984kg\" (UniqueName: \"kubernetes.io/projected/04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c-kube-api-access-984kg\") pod \"limitador-limitador-54d6d988d5-qkztl\" (UID: \"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.689531 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.689424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:29.823444 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:29.823419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:35:29.825441 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:35:29.825402    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d4dcbc_c6fe_40a7_8ae3_e80fb9cd4e1c.slice/crio-2d8028a61f9a67e3282f343fbd79a2a3b271d4c5a7e201104d563b047c3f79b3 WatchSource:0}: Error finding container 2d8028a61f9a67e3282f343fbd79a2a3b271d4c5a7e201104d563b047c3f79b3: Status 404 returned error can't find the container with id 2d8028a61f9a67e3282f343fbd79a2a3b271d4c5a7e201104d563b047c3f79b3
Jul 29 06:35:30.146294 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:30.146262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl" event={"ID":"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c","Type":"ContainerStarted","Data":"2d8028a61f9a67e3282f343fbd79a2a3b271d4c5a7e201104d563b047c3f79b3"}
Jul 29 06:35:33.166571 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:33.166534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl" event={"ID":"04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c","Type":"ContainerStarted","Data":"bb664e3138d7bdd3992c048a929822863547311e2ea72e910afdd91258069ff9"}
Jul 29 06:35:33.166997 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:33.166604    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:35:33.182882 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:33.182831    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl" podStartSLOduration=1.496594231 podStartE2EDuration="4.182814087s" totalImagesPullingTime="2.686219856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:35:33.180770077 +0000 UTC m=+774.816361869" watchObservedRunningTime="2026-07-29 06:35:33.182814087 +0000 UTC m=+774.818405878"
Jul 29 06:35:44.173955 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:35:44.173923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qkztl"
Jul 29 06:36:44.820330 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:36:44.820293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:37:01.709217 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:01.709179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:37:10.506170 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:10.506134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:37:14.896494 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.896445    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"]
Jul 29 06:37:14.899441 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.899402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:14.906739 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.906667    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kkwjc\""
Jul 29 06:37:14.907820 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.907796    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 06:37:14.907820 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.907812    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 06:37:14.908130 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.908111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 06:37:14.910886 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:14.910867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"]
Jul 29 06:37:15.075322 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.075286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.075492 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.075462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzxw5\" (UniqueName: \"kubernetes.io/projected/37871dbb-3580-4a22-b65b-3e2c874a04a2-kube-api-access-wzxw5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.075559 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.075535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.075616 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.075601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.075685 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.075628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.075685 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.075659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37871dbb-3580-4a22-b65b-3e2c874a04a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176220 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176220 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzxw5\" (UniqueName: \"kubernetes.io/projected/37871dbb-3580-4a22-b65b-3e2c874a04a2-kube-api-access-wzxw5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176561 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37871dbb-3580-4a22-b65b-3e2c874a04a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176615 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176754 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.176868 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.176737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.178770 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.178749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37871dbb-3580-4a22-b65b-3e2c874a04a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.179021 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.179005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37871dbb-3580-4a22-b65b-3e2c874a04a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.183385 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.183362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzxw5\" (UniqueName: \"kubernetes.io/projected/37871dbb-3580-4a22-b65b-3e2c874a04a2-kube-api-access-wzxw5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-br8m8\" (UID: \"37871dbb-3580-4a22-b65b-3e2c874a04a2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.217883 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.217845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:15.355645 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.355616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"]
Jul 29 06:37:15.357642 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:37:15.357614    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37871dbb_3580_4a22_b65b_3e2c874a04a2.slice/crio-145e4ac8f85f304011fd2dbb9283cfb856f6d9cef2c4d2a08b094e8c10802e85 WatchSource:0}: Error finding container 145e4ac8f85f304011fd2dbb9283cfb856f6d9cef2c4d2a08b094e8c10802e85: Status 404 returned error can't find the container with id 145e4ac8f85f304011fd2dbb9283cfb856f6d9cef2c4d2a08b094e8c10802e85
Jul 29 06:37:15.710822 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:15.710657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8" event={"ID":"37871dbb-3580-4a22-b65b-3e2c874a04a2","Type":"ContainerStarted","Data":"145e4ac8f85f304011fd2dbb9283cfb856f6d9cef2c4d2a08b094e8c10802e85"}
Jul 29 06:37:16.209812 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:16.209777    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:37:16.717216 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:16.717175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8" event={"ID":"37871dbb-3580-4a22-b65b-3e2c874a04a2","Type":"ContainerStarted","Data":"0b3bf0588c5ce3a71e097a957312c561f951a0599c589ab6af3ef98166a4f26c"}
Jul 29 06:37:16.735792 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:16.735727    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8" podStartSLOduration=1.784022131 podStartE2EDuration="2.735695596s" totalImagesPullingTime="951.673465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:37:16.733302776 +0000 UTC m=+878.368894613" watchObservedRunningTime="2026-07-29 06:37:16.735695596 +0000 UTC m=+878.371287387"
Jul 29 06:37:25.218284 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:25.218237    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:25.218753 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:25.218299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:25.230858 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:25.230833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:25.775559 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:25.775531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-br8m8"
Jul 29 06:37:31.513746 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:31.513624    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:37:38.845253 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:38.845226    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:37:38.847228 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:38.847206    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:37:38.849824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:38.849804    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:37:38.851642 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:38.851621    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:37:59.405521 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:37:59.405469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:38:12.309080 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:38:12.309043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:39:34.112418 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:39:34.112376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:39:44.299324 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:39:44.299288    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:39:54.510042 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:39:54.510006    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:41:34.606244 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:41:34.606205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:41:44.015858 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:41:44.015818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:42:12.702475 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:12.702432    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:42:22.111950 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:22.111917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:42:32.605345 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:32.605308    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:42:38.210859 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:38.210823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:42:38.880671 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:38.880645    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:42:38.884643 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:38.884619    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:42:38.884863 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:38.884846    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:42:38.889177 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:38.889159    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:42:48.847615 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:48.847578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:42:59.108762 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:42:59.108725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:43:09.711277 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:43:09.711243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:43:19.804310 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:43:19.804277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:43:41.804849 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:43:41.804766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:43:54.508221 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:43:54.508190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:44:16.710331 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:44:16.710290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:44:28.808246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:44:28.808204    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:44:38.405198 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:44:38.405162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:44:54.605320 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:44:54.605281    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:45:03.806062 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:45:03.805976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:45:13.412964 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:45:13.412929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:45:22.907465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:45:22.907433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:45:32.407016 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:45:32.406974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:45:57.834013 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:45:57.833975    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"]
Jul 29 06:45:57.834608 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:45:57.834161    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c" podUID="6be1fe4e-9817-4302-8719-a2ef07b41ac8" containerName="manager" containerID="cri-o://083bcb759ca32ee877820db539e40b593b39732481f90996a5800640b4d74e25" gracePeriod=10
Jul 29 06:46:00.566735 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.566684    2578 generic.go:356] "Generic (PLEG): container finished" podID="6be1fe4e-9817-4302-8719-a2ef07b41ac8" containerID="083bcb759ca32ee877820db539e40b593b39732481f90996a5800640b4d74e25" exitCode=0
Jul 29 06:46:00.567111 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.566753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c" event={"ID":"6be1fe4e-9817-4302-8719-a2ef07b41ac8","Type":"ContainerDied","Data":"083bcb759ca32ee877820db539e40b593b39732481f90996a5800640b4d74e25"}
Jul 29 06:46:00.595660 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.595636    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:46:00.752735 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.752668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be1fe4e-9817-4302-8719-a2ef07b41ac8-extensions-socket-volume\") pod \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") "
Jul 29 06:46:00.752939 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.752748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srcps\" (UniqueName: \"kubernetes.io/projected/6be1fe4e-9817-4302-8719-a2ef07b41ac8-kube-api-access-srcps\") pod \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\" (UID: \"6be1fe4e-9817-4302-8719-a2ef07b41ac8\") "
Jul 29 06:46:00.753052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.753027    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be1fe4e-9817-4302-8719-a2ef07b41ac8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6be1fe4e-9817-4302-8719-a2ef07b41ac8" (UID: "6be1fe4e-9817-4302-8719-a2ef07b41ac8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 06:46:00.754979 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.754955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be1fe4e-9817-4302-8719-a2ef07b41ac8-kube-api-access-srcps" (OuterVolumeSpecName: "kube-api-access-srcps") pod "6be1fe4e-9817-4302-8719-a2ef07b41ac8" (UID: "6be1fe4e-9817-4302-8719-a2ef07b41ac8"). InnerVolumeSpecName "kube-api-access-srcps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:46:00.853925 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.853887    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be1fe4e-9817-4302-8719-a2ef07b41ac8-extensions-socket-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:46:00.853925 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:00.853917    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srcps\" (UniqueName: \"kubernetes.io/projected/6be1fe4e-9817-4302-8719-a2ef07b41ac8-kube-api-access-srcps\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:46:01.573304 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:01.573272    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"
Jul 29 06:46:01.573304 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:01.573279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c" event={"ID":"6be1fe4e-9817-4302-8719-a2ef07b41ac8","Type":"ContainerDied","Data":"97c194afb12a3ee6fa4eff73d71cee14666ab6288c7d55b6dd7cb247c78c141a"}
Jul 29 06:46:01.573839 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:01.573346    2578 scope.go:117] "RemoveContainer" containerID="083bcb759ca32ee877820db539e40b593b39732481f90996a5800640b4d74e25"
Jul 29 06:46:01.590549 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:01.590517    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"]
Jul 29 06:46:01.593852 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:01.593824    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fdp7c"]
Jul 29 06:46:02.904667 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:02.904635    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be1fe4e-9817-4302-8719-a2ef07b41ac8" path="/var/lib/kubelet/pods/6be1fe4e-9817-4302-8719-a2ef07b41ac8/volumes"
Jul 29 06:46:58.951529 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.951495    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"]
Jul 29 06:46:58.951963 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.951857    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be1fe4e-9817-4302-8719-a2ef07b41ac8" containerName="manager"
Jul 29 06:46:58.951963 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.951867    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be1fe4e-9817-4302-8719-a2ef07b41ac8" containerName="manager"
Jul 29 06:46:58.951963 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.951945    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be1fe4e-9817-4302-8719-a2ef07b41ac8" containerName="manager"
Jul 29 06:46:58.955943 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.955927    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:58.958223 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.958204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nz2bt\""
Jul 29 06:46:58.966221 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:58.966197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"]
Jul 29 06:46:59.075308 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.075269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c0b608-ff01-4b55-8d7c-b3963130cffa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hf977\" (UID: \"a1c0b608-ff01-4b55-8d7c-b3963130cffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.075489 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.075350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljfp\" (UniqueName: \"kubernetes.io/projected/a1c0b608-ff01-4b55-8d7c-b3963130cffa-kube-api-access-8ljfp\") pod \"kuadrant-operator-controller-manager-86878c769f-hf977\" (UID: \"a1c0b608-ff01-4b55-8d7c-b3963130cffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.176082 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.176047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c0b608-ff01-4b55-8d7c-b3963130cffa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hf977\" (UID: \"a1c0b608-ff01-4b55-8d7c-b3963130cffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.176249 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.176123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljfp\" (UniqueName: \"kubernetes.io/projected/a1c0b608-ff01-4b55-8d7c-b3963130cffa-kube-api-access-8ljfp\") pod \"kuadrant-operator-controller-manager-86878c769f-hf977\" (UID: \"a1c0b608-ff01-4b55-8d7c-b3963130cffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.176403 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.176384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c0b608-ff01-4b55-8d7c-b3963130cffa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hf977\" (UID: \"a1c0b608-ff01-4b55-8d7c-b3963130cffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.186288 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.186252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljfp\" (UniqueName: \"kubernetes.io/projected/a1c0b608-ff01-4b55-8d7c-b3963130cffa-kube-api-access-8ljfp\") pod \"kuadrant-operator-controller-manager-86878c769f-hf977\" (UID: \"a1c0b608-ff01-4b55-8d7c-b3963130cffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.265794 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.265624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.408036 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.408008    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"]
Jul 29 06:46:59.410244 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:46:59.410217    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c0b608_ff01_4b55_8d7c_b3963130cffa.slice/crio-6013e2247d6e6866b9cb5656fb977d4e86bb4281a7317a1685b3354a78ed02c6 WatchSource:0}: Error finding container 6013e2247d6e6866b9cb5656fb977d4e86bb4281a7317a1685b3354a78ed02c6: Status 404 returned error can't find the container with id 6013e2247d6e6866b9cb5656fb977d4e86bb4281a7317a1685b3354a78ed02c6
Jul 29 06:46:59.884673 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.884631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977" event={"ID":"a1c0b608-ff01-4b55-8d7c-b3963130cffa","Type":"ContainerStarted","Data":"d02516663110c78ab3d2f9927c474a6f2131863a93a53ab690c88963e88ae1c4"}
Jul 29 06:46:59.884859 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.884720    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977" event={"ID":"a1c0b608-ff01-4b55-8d7c-b3963130cffa","Type":"ContainerStarted","Data":"6013e2247d6e6866b9cb5656fb977d4e86bb4281a7317a1685b3354a78ed02c6"}
Jul 29 06:46:59.884859 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.884748    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:46:59.908489 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:46:59.908435    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977" podStartSLOduration=1.90841982 podStartE2EDuration="1.90841982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:46:59.906651816 +0000 UTC m=+1461.542243607" watchObservedRunningTime="2026-07-29 06:46:59.90841982 +0000 UTC m=+1461.544011612"
Jul 29 06:47:10.892959 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:10.892929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hf977"
Jul 29 06:47:20.503473 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:20.503433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:47:31.400054 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:31.400012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:47:38.915063 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:38.915039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:47:38.919265 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:38.919245    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:47:38.921389 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:38.921366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:47:38.925631 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:38.925608    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:47:46.500996 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:46.500966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:47:58.109296 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:47:58.109254    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:48:08.301852 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:48:08.301772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:48:18.204895 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:48:18.204848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:48:28.704112 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:48:28.704077    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:48:39.601075 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:48:39.601041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:48:48.107735 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:48:48.107685    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:48:58.905393 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:48:58.905359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:49:10.405186 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:49:10.405144    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:49:19.809881 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:49:19.809840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:49:36.504221 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:49:36.504132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:49:45.913873 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:49:45.913836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:50:03.412238 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:50:03.412197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:50:24.506896 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:50:24.506862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:50:35.807200 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:50:35.807166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:50:44.611007 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:50:44.610966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:50:56.114723 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:50:56.114689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:51:06.007894 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:51:06.007859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:51:15.304215 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:51:15.304171    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:51:25.807563 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:51:25.807529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:51:35.109335 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:51:35.109297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:51:44.311951 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:51:44.311917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:51:56.908476 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:51:56.908441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:52:06.406768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:06.406731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:52:15.606637 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:15.606602    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:52:27.408060 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:27.408025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:52:38.956148 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:38.956123    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:52:38.961208 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:38.961182    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:52:38.971401 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:38.971385    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:52:38.975305 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:38.975289    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:52:40.001013 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:40.000977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:52:48.213356 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:48.213319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:52:59.202996 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:52:59.202966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:53:08.806857 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:53:08.806821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:53:18.108131 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:53:18.108092    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:53:24.608146 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:53:24.608114    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:53:38.811062 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:53:38.811022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:53:51.314031 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:53:51.313991    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:54:00.461906 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.461815    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"]
Jul 29 06:54:00.465672 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.465655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.468171 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.468150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-93562a48-dockercfg-6w8kf\""
Jul 29 06:54:00.468278 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.468150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-93562a48\""
Jul 29 06:54:00.474657 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.474634    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"]
Jul 29 06:54:00.500378 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.500353    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"]
Jul 29 06:54:00.503799 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.503784    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.514317 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.514280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"]
Jul 29 06:54:00.589745 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.589688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ce835e-7c9f-4e60-af2e-fbe515681240-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.589898 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.589773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lv2c\" (UniqueName: \"kubernetes.io/projected/02ce835e-7c9f-4e60-af2e-fbe515681240-kube-api-access-6lv2c\") pod \"payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.691271 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.691235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssnbr\" (UniqueName: \"kubernetes.io/projected/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-kube-api-access-ssnbr\") pod \"payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") " pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.691457 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.691279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-plugins-config-volume\") pod \"payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") " pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.691457 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.691350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ce835e-7c9f-4e60-af2e-fbe515681240-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.691457 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.691379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lv2c\" (UniqueName: \"kubernetes.io/projected/02ce835e-7c9f-4e60-af2e-fbe515681240-kube-api-access-6lv2c\") pod \"payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.692135 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.692109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ce835e-7c9f-4e60-af2e-fbe515681240-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.700557 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.700532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lv2c\" (UniqueName: \"kubernetes.io/projected/02ce835e-7c9f-4e60-af2e-fbe515681240-kube-api-access-6lv2c\") pod \"payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.776947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.776866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:00.792455 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.792425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-plugins-config-volume\") pod \"payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") " pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.792602 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.792561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssnbr\" (UniqueName: \"kubernetes.io/projected/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-kube-api-access-ssnbr\") pod \"payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") " pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.793330 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.793303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-plugins-config-volume\") pod \"payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") " pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.800626 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.800605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssnbr\" (UniqueName: \"kubernetes.io/projected/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-kube-api-access-ssnbr\") pod \"payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") " pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.814450 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.814424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:00.962051 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.962027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"]
Jul 29 06:54:00.963891 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:54:00.963861    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d5f2d8_ad45_49ea_8e71_b5e008a7de85.slice/crio-ebcb6745279bf017fb73a64f12ecc365bc51786371e120f387e2c014bf68798a WatchSource:0}: Error finding container ebcb6745279bf017fb73a64f12ecc365bc51786371e120f387e2c014bf68798a: Status 404 returned error can't find the container with id ebcb6745279bf017fb73a64f12ecc365bc51786371e120f387e2c014bf68798a
Jul 29 06:54:00.965814 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:00.965797    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 06:54:01.136323 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:01.136295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"]
Jul 29 06:54:01.137901 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:54:01.137873    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ce835e_7c9f_4e60_af2e_fbe515681240.slice/crio-541a16496d7b4713b5ef0016e6aadc630fdfa91e0813533c1cd7db4e186e9607 WatchSource:0}: Error finding container 541a16496d7b4713b5ef0016e6aadc630fdfa91e0813533c1cd7db4e186e9607: Status 404 returned error can't find the container with id 541a16496d7b4713b5ef0016e6aadc630fdfa91e0813533c1cd7db4e186e9607
Jul 29 06:54:01.165033 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:01.165002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx" event={"ID":"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85","Type":"ContainerStarted","Data":"ebcb6745279bf017fb73a64f12ecc365bc51786371e120f387e2c014bf68798a"}
Jul 29 06:54:01.166170 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:01.166146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9" event={"ID":"02ce835e-7c9f-4e60-af2e-fbe515681240","Type":"ContainerStarted","Data":"541a16496d7b4713b5ef0016e6aadc630fdfa91e0813533c1cd7db4e186e9607"}
Jul 29 06:54:03.189013 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:03.188966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx" event={"ID":"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85","Type":"ContainerStarted","Data":"90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b"}
Jul 29 06:54:03.189494 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:03.189106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:03.190578 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:03.190547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9" event={"ID":"02ce835e-7c9f-4e60-af2e-fbe515681240","Type":"ContainerStarted","Data":"146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2"}
Jul 29 06:54:03.190702 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:03.190638    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:03.203848 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:03.203800    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx" podStartSLOduration=1.178630743 podStartE2EDuration="3.203784187s" totalImagesPullingTime="2.025153444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:54:03.203253863 +0000 UTC m=+1884.838845654" watchObservedRunningTime="2026-07-29 06:54:03.203784187 +0000 UTC m=+1884.839376026"
Jul 29 06:54:03.218686 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:03.218629    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9" podStartSLOduration=1.373580705 podStartE2EDuration="3.218612726s" totalImagesPullingTime="1.845032021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:54:03.216475696 +0000 UTC m=+1884.852067502" watchObservedRunningTime="2026-07-29 06:54:03.218612726 +0000 UTC m=+1884.854204566"
Jul 29 06:54:07.301965 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:07.301932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:54:14.198918 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:14.198889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:14.199481 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:14.198966    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:25.342359 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.342329    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"]
Jul 29 06:54:25.347465 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.347449    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:25.350018 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.349990    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 06:54:25.350180 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.350149    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 06:54:25.351908 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.351888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"]
Jul 29 06:54:25.413063 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.413031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fc6dd3e-6ee5-4325-a232-65517349103b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93562a48-pw7cd\" (UID: \"7fc6dd3e-6ee5-4325-a232-65517349103b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:25.514463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.514434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fc6dd3e-6ee5-4325-a232-65517349103b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93562a48-pw7cd\" (UID: \"7fc6dd3e-6ee5-4325-a232-65517349103b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:25.515082 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.515064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fc6dd3e-6ee5-4325-a232-65517349103b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93562a48-pw7cd\" (UID: \"7fc6dd3e-6ee5-4325-a232-65517349103b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:25.659504 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:25.659475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:26.003243 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:26.003066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"]
Jul 29 06:54:26.006095 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:54:26.006068    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc6dd3e_6ee5_4325_a232_65517349103b.slice/crio-6caead81adb98aa978914bfffd9cbcbfbf54251af00e93bda3e01a8e09b51f1b WatchSource:0}: Error finding container 6caead81adb98aa978914bfffd9cbcbfbf54251af00e93bda3e01a8e09b51f1b: Status 404 returned error can't find the container with id 6caead81adb98aa978914bfffd9cbcbfbf54251af00e93bda3e01a8e09b51f1b
Jul 29 06:54:26.315603 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:26.315517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd" event={"ID":"7fc6dd3e-6ee5-4325-a232-65517349103b","Type":"ContainerStarted","Data":"6caead81adb98aa978914bfffd9cbcbfbf54251af00e93bda3e01a8e09b51f1b"}
Jul 29 06:54:29.335911 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:29.335880    2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc6dd3e-6ee5-4325-a232-65517349103b" containerID="4be06fcbca7852d5a9962f1a03e66c09d85d786215073ab6ae68750858d0995d" exitCode=0
Jul 29 06:54:29.336345 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:29.335965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd" event={"ID":"7fc6dd3e-6ee5-4325-a232-65517349103b","Type":"ContainerDied","Data":"4be06fcbca7852d5a9962f1a03e66c09d85d786215073ab6ae68750858d0995d"}
Jul 29 06:54:30.476411 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:30.476389    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:30.560410 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:30.560384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fc6dd3e-6ee5-4325-a232-65517349103b-maas-api-service-ca\") pod \"7fc6dd3e-6ee5-4325-a232-65517349103b\" (UID: \"7fc6dd3e-6ee5-4325-a232-65517349103b\") "
Jul 29 06:54:30.560751 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:30.560727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fc6dd3e-6ee5-4325-a232-65517349103b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7fc6dd3e-6ee5-4325-a232-65517349103b" (UID: "7fc6dd3e-6ee5-4325-a232-65517349103b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:54:30.661678 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:30.661642    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fc6dd3e-6ee5-4325-a232-65517349103b-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:54:31.347554 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:31.347518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd" event={"ID":"7fc6dd3e-6ee5-4325-a232-65517349103b","Type":"ContainerDied","Data":"6caead81adb98aa978914bfffd9cbcbfbf54251af00e93bda3e01a8e09b51f1b"}
Jul 29 06:54:31.347743 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:31.347573    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6caead81adb98aa978914bfffd9cbcbfbf54251af00e93bda3e01a8e09b51f1b"
Jul 29 06:54:31.347743 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:31.347530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"
Jul 29 06:54:40.491150 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.491115    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"]
Jul 29 06:54:40.491561 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.491405    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx" podUID="f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" containerName="payload-processing" containerID="cri-o://90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b" gracePeriod=30
Jul 29 06:54:40.503300 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.503271    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"]
Jul 29 06:54:40.503521 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.503494    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9" podUID="02ce835e-7c9f-4e60-af2e-fbe515681240" containerName="payload-pre-processing" containerID="cri-o://146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2" gracePeriod=30
Jul 29 06:54:40.629601 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.629571    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"]
Jul 29 06:54:40.631938 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.631910    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93562a48-pw7cd"]
Jul 29 06:54:40.798032 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.798009    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:40.801086 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.801065    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:40.904661 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.904626    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fc6dd3e-6ee5-4325-a232-65517349103b" path="/var/lib/kubelet/pods/7fc6dd3e-6ee5-4325-a232-65517349103b/volumes"
Jul 29 06:54:40.952278 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.952253    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lv2c\" (UniqueName: \"kubernetes.io/projected/02ce835e-7c9f-4e60-af2e-fbe515681240-kube-api-access-6lv2c\") pod \"02ce835e-7c9f-4e60-af2e-fbe515681240\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") "
Jul 29 06:54:40.952448 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.952287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssnbr\" (UniqueName: \"kubernetes.io/projected/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-kube-api-access-ssnbr\") pod \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") "
Jul 29 06:54:40.952448 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.952324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ce835e-7c9f-4e60-af2e-fbe515681240-plugins-config-volume\") pod \"02ce835e-7c9f-4e60-af2e-fbe515681240\" (UID: \"02ce835e-7c9f-4e60-af2e-fbe515681240\") "
Jul 29 06:54:40.952448 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.952348    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-plugins-config-volume\") pod \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\" (UID: \"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85\") "
Jul 29 06:54:40.952739 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.952693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ce835e-7c9f-4e60-af2e-fbe515681240-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02ce835e-7c9f-4e60-af2e-fbe515681240" (UID: "02ce835e-7c9f-4e60-af2e-fbe515681240"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:54:40.953078 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.952954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" (UID: "f8d5f2d8-ad45-49ea-8e71-b5e008a7de85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:54:40.954738 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.954686    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-kube-api-access-ssnbr" (OuterVolumeSpecName: "kube-api-access-ssnbr") pod "f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" (UID: "f8d5f2d8-ad45-49ea-8e71-b5e008a7de85"). InnerVolumeSpecName "kube-api-access-ssnbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:54:40.954830 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:40.954702    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ce835e-7c9f-4e60-af2e-fbe515681240-kube-api-access-6lv2c" (OuterVolumeSpecName: "kube-api-access-6lv2c") pod "02ce835e-7c9f-4e60-af2e-fbe515681240" (UID: "02ce835e-7c9f-4e60-af2e-fbe515681240"). InnerVolumeSpecName "kube-api-access-6lv2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:54:41.053992 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.053910    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lv2c\" (UniqueName: \"kubernetes.io/projected/02ce835e-7c9f-4e60-af2e-fbe515681240-kube-api-access-6lv2c\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:54:41.053992 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.053939    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssnbr\" (UniqueName: \"kubernetes.io/projected/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-kube-api-access-ssnbr\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:54:41.053992 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.053952    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02ce835e-7c9f-4e60-af2e-fbe515681240-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:54:41.053992 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.053965    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:54:41.400943 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.400908    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" containerID="90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b" exitCode=0
Jul 29 06:54:41.401098 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.400974    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"
Jul 29 06:54:41.401098 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.401029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx" event={"ID":"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85","Type":"ContainerDied","Data":"90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b"}
Jul 29 06:54:41.401098 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.401085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx" event={"ID":"f8d5f2d8-ad45-49ea-8e71-b5e008a7de85","Type":"ContainerDied","Data":"ebcb6745279bf017fb73a64f12ecc365bc51786371e120f387e2c014bf68798a"}
Jul 29 06:54:41.401261 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.401116    2578 scope.go:117] "RemoveContainer" containerID="90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b"
Jul 29 06:54:41.402556 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.402533    2578 generic.go:356] "Generic (PLEG): container finished" podID="02ce835e-7c9f-4e60-af2e-fbe515681240" containerID="146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2" exitCode=0
Jul 29 06:54:41.402661 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.402579    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"
Jul 29 06:54:41.402661 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.402631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9" event={"ID":"02ce835e-7c9f-4e60-af2e-fbe515681240","Type":"ContainerDied","Data":"146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2"}
Jul 29 06:54:41.402974 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.402675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9" event={"ID":"02ce835e-7c9f-4e60-af2e-fbe515681240","Type":"ContainerDied","Data":"541a16496d7b4713b5ef0016e6aadc630fdfa91e0813533c1cd7db4e186e9607"}
Jul 29 06:54:41.412621 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.412599    2578 scope.go:117] "RemoveContainer" containerID="90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b"
Jul 29 06:54:41.412919 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:54:41.412899    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b\": container with ID starting with 90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b not found: ID does not exist" containerID="90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b"
Jul 29 06:54:41.413019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.412927    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b"} err="failed to get container status \"90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b\": rpc error: code = NotFound desc = could not find container \"90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b\": container with ID starting with 90c8e10a48dbfaf5adc17f0311d5c079e04cfa090c2ce88b91d5d2496dacee3b not found: ID does not exist"
Jul 29 06:54:41.413019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.412950    2578 scope.go:117] "RemoveContainer" containerID="146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2"
Jul 29 06:54:41.421457 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.421441    2578 scope.go:117] "RemoveContainer" containerID="146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2"
Jul 29 06:54:41.421726 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:54:41.421696    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2\": container with ID starting with 146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2 not found: ID does not exist" containerID="146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2"
Jul 29 06:54:41.421783 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.421737    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2"} err="failed to get container status \"146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2\": rpc error: code = NotFound desc = could not find container \"146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2\": container with ID starting with 146a426f9d37cf040026ad5c68c0cc051f221b9f7e0b665b907e8f663ddb39c2 not found: ID does not exist"
Jul 29 06:54:41.429762 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.429696    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"]
Jul 29 06:54:41.437297 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.437273    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx"]
Jul 29 06:54:41.449832 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.449807    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"]
Jul 29 06:54:41.455795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:41.455768    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9"]
Jul 29 06:54:42.904252 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:42.904214    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ce835e-7c9f-4e60-af2e-fbe515681240" path="/var/lib/kubelet/pods/02ce835e-7c9f-4e60-af2e-fbe515681240/volumes"
Jul 29 06:54:42.904759 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:42.904743    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" path="/var/lib/kubelet/pods/f8d5f2d8-ad45-49ea-8e71-b5e008a7de85/volumes"
Jul 29 06:54:44.507506 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.507472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:54:44.745507 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745474    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"]
Jul 29 06:54:44.745888 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745874    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" containerName="payload-processing"
Jul 29 06:54:44.745947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745889    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" containerName="payload-processing"
Jul 29 06:54:44.745947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745909    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc6dd3e-6ee5-4325-a232-65517349103b" containerName="revoke-keys"
Jul 29 06:54:44.745947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745915    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc6dd3e-6ee5-4325-a232-65517349103b" containerName="revoke-keys"
Jul 29 06:54:44.745947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745925    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ce835e-7c9f-4e60-af2e-fbe515681240" containerName="payload-pre-processing"
Jul 29 06:54:44.745947 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745930    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ce835e-7c9f-4e60-af2e-fbe515681240" containerName="payload-pre-processing"
Jul 29 06:54:44.746100 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745988    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ce835e-7c9f-4e60-af2e-fbe515681240" containerName="payload-pre-processing"
Jul 29 06:54:44.746100 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.745996    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fc6dd3e-6ee5-4325-a232-65517349103b" containerName="revoke-keys"
Jul 29 06:54:44.746100 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.746005    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d5f2d8-ad45-49ea-8e71-b5e008a7de85" containerName="payload-processing"
Jul 29 06:54:44.750551 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.750515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:44.753177 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.753153    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-89063c4d\""
Jul 29 06:54:44.753315 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.753156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-89063c4d-dockercfg-xndhm\""
Jul 29 06:54:44.759246 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.759187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"]
Jul 29 06:54:44.778918 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.778889    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"]
Jul 29 06:54:44.782231 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.782214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:44.790059 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.790032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"]
Jul 29 06:54:44.891195 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.891156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-986mx\" (UniqueName: \"kubernetes.io/projected/e54e2821-7e00-45d8-b29d-188334560edb-kube-api-access-986mx\") pod \"payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:44.891359 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.891207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54e2821-7e00-45d8-b29d-188334560edb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:44.891359 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.891288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3288a4-26ee-4a46-8ed0-807991342077-plugins-config-volume\") pod \"payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") " pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:44.891359 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.891319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhp8m\" (UniqueName: \"kubernetes.io/projected/0a3288a4-26ee-4a46-8ed0-807991342077-kube-api-access-vhp8m\") pod \"payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") " pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:44.991960 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.991922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-986mx\" (UniqueName: \"kubernetes.io/projected/e54e2821-7e00-45d8-b29d-188334560edb-kube-api-access-986mx\") pod \"payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:44.992110 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.991974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54e2821-7e00-45d8-b29d-188334560edb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:44.992110 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.992023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3288a4-26ee-4a46-8ed0-807991342077-plugins-config-volume\") pod \"payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") " pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:44.992110 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.992049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhp8m\" (UniqueName: \"kubernetes.io/projected/0a3288a4-26ee-4a46-8ed0-807991342077-kube-api-access-vhp8m\") pod \"payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") " pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:44.992808 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.992786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3288a4-26ee-4a46-8ed0-807991342077-plugins-config-volume\") pod \"payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") " pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:44.992854 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:44.992788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54e2821-7e00-45d8-b29d-188334560edb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:45.003120 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.003085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhp8m\" (UniqueName: \"kubernetes.io/projected/0a3288a4-26ee-4a46-8ed0-807991342077-kube-api-access-vhp8m\") pod \"payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") " pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:45.003249 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.003151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-986mx\" (UniqueName: \"kubernetes.io/projected/e54e2821-7e00-45d8-b29d-188334560edb-kube-api-access-986mx\") pod \"payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:45.064082 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.064003    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:45.092916 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.092881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:45.221195 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.221127    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"]
Jul 29 06:54:45.222651 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:54:45.222611    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54e2821_7e00_45d8_b29d_188334560edb.slice/crio-7f42d148cd66096fe7f00d6b8a6c544b10b28082e6c8f556d871a1d9bf7b8c11 WatchSource:0}: Error finding container 7f42d148cd66096fe7f00d6b8a6c544b10b28082e6c8f556d871a1d9bf7b8c11: Status 404 returned error can't find the container with id 7f42d148cd66096fe7f00d6b8a6c544b10b28082e6c8f556d871a1d9bf7b8c11
Jul 29 06:54:45.251597 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.251559    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"]
Jul 29 06:54:45.256101 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:54:45.256072    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3288a4_26ee_4a46_8ed0_807991342077.slice/crio-861cb1dc2420d6688b78a2aa053ada2ccff4d4ee83717958953b5e3eff93de92 WatchSource:0}: Error finding container 861cb1dc2420d6688b78a2aa053ada2ccff4d4ee83717958953b5e3eff93de92: Status 404 returned error can't find the container with id 861cb1dc2420d6688b78a2aa053ada2ccff4d4ee83717958953b5e3eff93de92
Jul 29 06:54:45.427480 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.427448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl" event={"ID":"e54e2821-7e00-45d8-b29d-188334560edb","Type":"ContainerStarted","Data":"41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31"}
Jul 29 06:54:45.427689 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.427506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl" event={"ID":"e54e2821-7e00-45d8-b29d-188334560edb","Type":"ContainerStarted","Data":"7f42d148cd66096fe7f00d6b8a6c544b10b28082e6c8f556d871a1d9bf7b8c11"}
Jul 29 06:54:45.427689 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.427626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:54:45.428968 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.428943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn" event={"ID":"0a3288a4-26ee-4a46-8ed0-807991342077","Type":"ContainerStarted","Data":"e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66"}
Jul 29 06:54:45.429028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.428991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn" event={"ID":"0a3288a4-26ee-4a46-8ed0-807991342077","Type":"ContainerStarted","Data":"861cb1dc2420d6688b78a2aa053ada2ccff4d4ee83717958953b5e3eff93de92"}
Jul 29 06:54:45.429028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.429023    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:45.444665 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.444617    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl" podStartSLOduration=1.44460016 podStartE2EDuration="1.44460016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:54:45.442507992 +0000 UTC m=+1927.078099804" watchObservedRunningTime="2026-07-29 06:54:45.44460016 +0000 UTC m=+1927.080191952"
Jul 29 06:54:45.458828 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:45.458770    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn" podStartSLOduration=1.458750927 podStartE2EDuration="1.458750927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:54:45.456406806 +0000 UTC m=+1927.091998598" watchObservedRunningTime="2026-07-29 06:54:45.458750927 +0000 UTC m=+1927.094342718"
Jul 29 06:54:54.914823 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:54.914786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:54:56.437734 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:56.437678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:54:56.438113 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:54:56.437863    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:55:09.092890 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.092852    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"]
Jul 29 06:55:09.101020 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.100994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:09.103385 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.103361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"]
Jul 29 06:55:09.103864 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.103847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 06:55:09.104002 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.103847    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 06:55:09.177884 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.177850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7786a9b2-a1d7-4794-a2e2-2e10a8de1600-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z\" (UID: \"7786a9b2-a1d7-4794-a2e2-2e10a8de1600\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:09.278447 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.278404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7786a9b2-a1d7-4794-a2e2-2e10a8de1600-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z\" (UID: \"7786a9b2-a1d7-4794-a2e2-2e10a8de1600\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:09.279056 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.279030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7786a9b2-a1d7-4794-a2e2-2e10a8de1600-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z\" (UID: \"7786a9b2-a1d7-4794-a2e2-2e10a8de1600\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:09.413338 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.413300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:09.546313 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.546289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"]
Jul 29 06:55:09.549680 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:55:09.549648    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7786a9b2_a1d7_4794_a2e2_2e10a8de1600.slice/crio-924a64423bb41ffc13d01ac411fcd6da205c0823ca1ee7db9b1432f3e3c50cf7 WatchSource:0}: Error finding container 924a64423bb41ffc13d01ac411fcd6da205c0823ca1ee7db9b1432f3e3c50cf7: Status 404 returned error can't find the container with id 924a64423bb41ffc13d01ac411fcd6da205c0823ca1ee7db9b1432f3e3c50cf7
Jul 29 06:55:09.564941 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:09.564895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z" event={"ID":"7786a9b2-a1d7-4794-a2e2-2e10a8de1600","Type":"ContainerStarted","Data":"924a64423bb41ffc13d01ac411fcd6da205c0823ca1ee7db9b1432f3e3c50cf7"}
Jul 29 06:55:10.572052 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:10.571971    2578 generic.go:356] "Generic (PLEG): container finished" podID="7786a9b2-a1d7-4794-a2e2-2e10a8de1600" containerID="1dcb71a83d095dedb7afcc18024fb13960836170b26d3dc12ae71612142051e6" exitCode=0
Jul 29 06:55:10.572390 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:10.572057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z" event={"ID":"7786a9b2-a1d7-4794-a2e2-2e10a8de1600","Type":"ContainerDied","Data":"1dcb71a83d095dedb7afcc18024fb13960836170b26d3dc12ae71612142051e6"}
Jul 29 06:55:11.714586 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:11.714554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:11.799590 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:11.799550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7786a9b2-a1d7-4794-a2e2-2e10a8de1600-maas-api-service-ca\") pod \"7786a9b2-a1d7-4794-a2e2-2e10a8de1600\" (UID: \"7786a9b2-a1d7-4794-a2e2-2e10a8de1600\") "
Jul 29 06:55:11.799935 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:11.799913    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7786a9b2-a1d7-4794-a2e2-2e10a8de1600-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7786a9b2-a1d7-4794-a2e2-2e10a8de1600" (UID: "7786a9b2-a1d7-4794-a2e2-2e10a8de1600"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:55:11.900472 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:11.900431    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7786a9b2-a1d7-4794-a2e2-2e10a8de1600-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:12.584737 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:12.584679    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"
Jul 29 06:55:12.584909 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:12.584675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z" event={"ID":"7786a9b2-a1d7-4794-a2e2-2e10a8de1600","Type":"ContainerDied","Data":"924a64423bb41ffc13d01ac411fcd6da205c0823ca1ee7db9b1432f3e3c50cf7"}
Jul 29 06:55:12.584909 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:12.584813    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="924a64423bb41ffc13d01ac411fcd6da205c0823ca1ee7db9b1432f3e3c50cf7"
Jul 29 06:55:14.675034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.674996    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"]
Jul 29 06:55:14.675560 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.675293    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn" podUID="0a3288a4-26ee-4a46-8ed0-807991342077" containerName="payload-processing" containerID="cri-o://e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66" gracePeriod=30
Jul 29 06:55:14.683403 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.683370    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"]
Jul 29 06:55:14.683614 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.683588    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl" podUID="e54e2821-7e00-45d8-b29d-188334560edb" containerName="payload-pre-processing" containerID="cri-o://41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31" gracePeriod=30
Jul 29 06:55:14.849022 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.848353    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"]
Jul 29 06:55:14.853149 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.852747    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89063c4d-fcl6z"]
Jul 29 06:55:14.906704 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.906670    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7786a9b2-a1d7-4794-a2e2-2e10a8de1600" path="/var/lib/kubelet/pods/7786a9b2-a1d7-4794-a2e2-2e10a8de1600/volumes"
Jul 29 06:55:14.981388 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.981365    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:55:14.984618 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:14.984576    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:55:15.036482 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.036450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3288a4-26ee-4a46-8ed0-807991342077-plugins-config-volume\") pod \"0a3288a4-26ee-4a46-8ed0-807991342077\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") "
Jul 29 06:55:15.036627 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.036546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-986mx\" (UniqueName: \"kubernetes.io/projected/e54e2821-7e00-45d8-b29d-188334560edb-kube-api-access-986mx\") pod \"e54e2821-7e00-45d8-b29d-188334560edb\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") "
Jul 29 06:55:15.036627 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.036589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhp8m\" (UniqueName: \"kubernetes.io/projected/0a3288a4-26ee-4a46-8ed0-807991342077-kube-api-access-vhp8m\") pod \"0a3288a4-26ee-4a46-8ed0-807991342077\" (UID: \"0a3288a4-26ee-4a46-8ed0-807991342077\") "
Jul 29 06:55:15.036627 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.036605    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54e2821-7e00-45d8-b29d-188334560edb-plugins-config-volume\") pod \"e54e2821-7e00-45d8-b29d-188334560edb\" (UID: \"e54e2821-7e00-45d8-b29d-188334560edb\") "
Jul 29 06:55:15.037010 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.036983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a3288a4-26ee-4a46-8ed0-807991342077-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a3288a4-26ee-4a46-8ed0-807991342077" (UID: "0a3288a4-26ee-4a46-8ed0-807991342077"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:55:15.037092 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.036988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e54e2821-7e00-45d8-b29d-188334560edb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e54e2821-7e00-45d8-b29d-188334560edb" (UID: "e54e2821-7e00-45d8-b29d-188334560edb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:55:15.039045 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.039018    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54e2821-7e00-45d8-b29d-188334560edb-kube-api-access-986mx" (OuterVolumeSpecName: "kube-api-access-986mx") pod "e54e2821-7e00-45d8-b29d-188334560edb" (UID: "e54e2821-7e00-45d8-b29d-188334560edb"). InnerVolumeSpecName "kube-api-access-986mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:55:15.039156 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.039045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3288a4-26ee-4a46-8ed0-807991342077-kube-api-access-vhp8m" (OuterVolumeSpecName: "kube-api-access-vhp8m") pod "0a3288a4-26ee-4a46-8ed0-807991342077" (UID: "0a3288a4-26ee-4a46-8ed0-807991342077"). InnerVolumeSpecName "kube-api-access-vhp8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:55:15.137399 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.137362    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-986mx\" (UniqueName: \"kubernetes.io/projected/e54e2821-7e00-45d8-b29d-188334560edb-kube-api-access-986mx\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:15.137399 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.137390    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhp8m\" (UniqueName: \"kubernetes.io/projected/0a3288a4-26ee-4a46-8ed0-807991342077-kube-api-access-vhp8m\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:15.137399 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.137407    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54e2821-7e00-45d8-b29d-188334560edb-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:15.137628 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.137416    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3288a4-26ee-4a46-8ed0-807991342077-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:15.602265 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.602230    2578 generic.go:356] "Generic (PLEG): container finished" podID="e54e2821-7e00-45d8-b29d-188334560edb" containerID="41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31" exitCode=0
Jul 29 06:55:15.602434 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.602276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"
Jul 29 06:55:15.602434 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.602319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl" event={"ID":"e54e2821-7e00-45d8-b29d-188334560edb","Type":"ContainerDied","Data":"41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31"}
Jul 29 06:55:15.602434 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.602390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl" event={"ID":"e54e2821-7e00-45d8-b29d-188334560edb","Type":"ContainerDied","Data":"7f42d148cd66096fe7f00d6b8a6c544b10b28082e6c8f556d871a1d9bf7b8c11"}
Jul 29 06:55:15.602434 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.602430    2578 scope.go:117] "RemoveContainer" containerID="41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31"
Jul 29 06:55:15.603824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.603790    2578 generic.go:356] "Generic (PLEG): container finished" podID="0a3288a4-26ee-4a46-8ed0-807991342077" containerID="e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66" exitCode=0
Jul 29 06:55:15.603954 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.603827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn" event={"ID":"0a3288a4-26ee-4a46-8ed0-807991342077","Type":"ContainerDied","Data":"e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66"}
Jul 29 06:55:15.603954 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.603885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn" event={"ID":"0a3288a4-26ee-4a46-8ed0-807991342077","Type":"ContainerDied","Data":"861cb1dc2420d6688b78a2aa053ada2ccff4d4ee83717958953b5e3eff93de92"}
Jul 29 06:55:15.603954 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.603834    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"
Jul 29 06:55:15.612569 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.612474    2578 scope.go:117] "RemoveContainer" containerID="41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31"
Jul 29 06:55:15.612844 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:55:15.612815    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31\": container with ID starting with 41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31 not found: ID does not exist" containerID="41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31"
Jul 29 06:55:15.612932 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.612858    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31"} err="failed to get container status \"41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31\": rpc error: code = NotFound desc = could not find container \"41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31\": container with ID starting with 41412c603e2bf4afcc927fe6c1edcd50ee720ede38a706e0221abaef14a71a31 not found: ID does not exist"
Jul 29 06:55:15.612932 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.612899    2578 scope.go:117] "RemoveContainer" containerID="e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66"
Jul 29 06:55:15.621174 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.621158    2578 scope.go:117] "RemoveContainer" containerID="e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66"
Jul 29 06:55:15.621426 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:55:15.621408    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66\": container with ID starting with e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66 not found: ID does not exist" containerID="e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66"
Jul 29 06:55:15.621468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.621433    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66"} err="failed to get container status \"e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66\": rpc error: code = NotFound desc = could not find container \"e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66\": container with ID starting with e85e7115e806c31114090a5777ec9313e257ada0a2ce126680f7fee66dce7a66 not found: ID does not exist"
Jul 29 06:55:15.627615 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.627595    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"]
Jul 29 06:55:15.631033 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.631014    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl"]
Jul 29 06:55:15.643659 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.643640    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"]
Jul 29 06:55:15.645699 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:15.645680    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn"]
Jul 29 06:55:16.904408 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:16.904380    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3288a4-26ee-4a46-8ed0-807991342077" path="/var/lib/kubelet/pods/0a3288a4-26ee-4a46-8ed0-807991342077/volumes"
Jul 29 06:55:16.904846 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:16.904737    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e54e2821-7e00-45d8-b29d-188334560edb" path="/var/lib/kubelet/pods/e54e2821-7e00-45d8-b29d-188334560edb/volumes"
Jul 29 06:55:18.612967 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.609102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:55:18.909021 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.908952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"]
Jul 29 06:55:18.909298 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909286    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3288a4-26ee-4a46-8ed0-807991342077" containerName="payload-processing"
Jul 29 06:55:18.909346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909300    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3288a4-26ee-4a46-8ed0-807991342077" containerName="payload-processing"
Jul 29 06:55:18.909346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909323    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7786a9b2-a1d7-4794-a2e2-2e10a8de1600" containerName="revoke-keys"
Jul 29 06:55:18.909346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909329    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7786a9b2-a1d7-4794-a2e2-2e10a8de1600" containerName="revoke-keys"
Jul 29 06:55:18.909346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909336    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e54e2821-7e00-45d8-b29d-188334560edb" containerName="payload-pre-processing"
Jul 29 06:55:18.909346 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909340    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e54e2821-7e00-45d8-b29d-188334560edb" containerName="payload-pre-processing"
Jul 29 06:55:18.909503 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909413    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3288a4-26ee-4a46-8ed0-807991342077" containerName="payload-processing"
Jul 29 06:55:18.909503 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909421    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e54e2821-7e00-45d8-b29d-188334560edb" containerName="payload-pre-processing"
Jul 29 06:55:18.909503 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.909428    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7786a9b2-a1d7-4794-a2e2-2e10a8de1600" containerName="revoke-keys"
Jul 29 06:55:18.914107 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.914090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:18.916741 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.916690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-88aa9015\""
Jul 29 06:55:18.922208 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.922188    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"]
Jul 29 06:55:18.952552 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.952515    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"]
Jul 29 06:55:18.956417 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.956399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:18.959910 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.959889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-88aa9015-dockercfg-kczvn\""
Jul 29 06:55:18.966582 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.966558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"]
Jul 29 06:55:18.974880 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.974856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2w7q\" (UniqueName: \"kubernetes.io/projected/2020363f-0618-43ca-a735-9c68e38cbcab-kube-api-access-t2w7q\") pod \"payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:18.974971 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:18.974906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2020363f-0618-43ca-a735-9c68e38cbcab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.075329 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.075297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqjm\" (UniqueName: \"kubernetes.io/projected/23be98b6-b064-466e-8227-08c9c138acba-kube-api-access-5vqjm\") pod \"payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") " pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.075483 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.075335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2w7q\" (UniqueName: \"kubernetes.io/projected/2020363f-0618-43ca-a735-9c68e38cbcab-kube-api-access-t2w7q\") pod \"payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.075483 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.075404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2020363f-0618-43ca-a735-9c68e38cbcab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.075483 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.075468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23be98b6-b064-466e-8227-08c9c138acba-plugins-config-volume\") pod \"payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") " pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.076130 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.076114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2020363f-0618-43ca-a735-9c68e38cbcab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.084365 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.084346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2w7q\" (UniqueName: \"kubernetes.io/projected/2020363f-0618-43ca-a735-9c68e38cbcab-kube-api-access-t2w7q\") pod \"payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.176127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.176037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23be98b6-b064-466e-8227-08c9c138acba-plugins-config-volume\") pod \"payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") " pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.176127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.176108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqjm\" (UniqueName: \"kubernetes.io/projected/23be98b6-b064-466e-8227-08c9c138acba-kube-api-access-5vqjm\") pod \"payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") " pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.176797 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.176774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23be98b6-b064-466e-8227-08c9c138acba-plugins-config-volume\") pod \"payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") " pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.184349 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.184325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqjm\" (UniqueName: \"kubernetes.io/projected/23be98b6-b064-466e-8227-08c9c138acba-kube-api-access-5vqjm\") pod \"payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") " pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.225477 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.225453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.266815 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.266781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.377768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.377736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"]
Jul 29 06:55:19.379390 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:55:19.379361    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2020363f_0618_43ca_a735_9c68e38cbcab.slice/crio-c4d873a59853fc48d54bda4342432414ccb6ff78b89c116a2f14252c5c55267c WatchSource:0}: Error finding container c4d873a59853fc48d54bda4342432414ccb6ff78b89c116a2f14252c5c55267c: Status 404 returned error can't find the container with id c4d873a59853fc48d54bda4342432414ccb6ff78b89c116a2f14252c5c55267c
Jul 29 06:55:19.423532 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.423504    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"]
Jul 29 06:55:19.426247 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:55:19.426205    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23be98b6_b064_466e_8227_08c9c138acba.slice/crio-28756afa12271c45da4ca12704548888ac4741cae25edaeff721786e1c6a9b2a WatchSource:0}: Error finding container 28756afa12271c45da4ca12704548888ac4741cae25edaeff721786e1c6a9b2a: Status 404 returned error can't find the container with id 28756afa12271c45da4ca12704548888ac4741cae25edaeff721786e1c6a9b2a
Jul 29 06:55:19.629855 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.629819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft" event={"ID":"23be98b6-b064-466e-8227-08c9c138acba","Type":"ContainerStarted","Data":"03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16"}
Jul 29 06:55:19.630303 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.629877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft" event={"ID":"23be98b6-b064-466e-8227-08c9c138acba","Type":"ContainerStarted","Data":"28756afa12271c45da4ca12704548888ac4741cae25edaeff721786e1c6a9b2a"}
Jul 29 06:55:19.630303 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.630005    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:19.631424 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.631388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj" event={"ID":"2020363f-0618-43ca-a735-9c68e38cbcab","Type":"ContainerStarted","Data":"0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22"}
Jul 29 06:55:19.631517 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.631439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:19.631517 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.631456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj" event={"ID":"2020363f-0618-43ca-a735-9c68e38cbcab","Type":"ContainerStarted","Data":"c4d873a59853fc48d54bda4342432414ccb6ff78b89c116a2f14252c5c55267c"}
Jul 29 06:55:19.645887 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.645843    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft" podStartSLOduration=1.645829681 podStartE2EDuration="1.645829681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:55:19.644188681 +0000 UTC m=+1961.279780473" watchObservedRunningTime="2026-07-29 06:55:19.645829681 +0000 UTC m=+1961.281421463"
Jul 29 06:55:19.660772 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:19.660723    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj" podStartSLOduration=1.66068948 podStartE2EDuration="1.66068948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:55:19.65905218 +0000 UTC m=+1961.294643970" watchObservedRunningTime="2026-07-29 06:55:19.66068948 +0000 UTC m=+1961.296281275"
Jul 29 06:55:29.410582 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:29.410546    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:55:30.639280 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:30.639248    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:30.639756 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:30.639318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:48.779272 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:48.779235    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"]
Jul 29 06:55:48.779910 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:48.779511    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft" podUID="23be98b6-b064-466e-8227-08c9c138acba" containerName="payload-processing" containerID="cri-o://03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16" gracePeriod=30
Jul 29 06:55:48.788773 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:48.788742    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"]
Jul 29 06:55:48.789006 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:48.788982    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj" podUID="2020363f-0618-43ca-a735-9c68e38cbcab" containerName="payload-pre-processing" containerID="cri-o://0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22" gracePeriod=30
Jul 29 06:55:49.081194 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.081168    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:49.084145 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.084125    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:49.143875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.143823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2020363f-0618-43ca-a735-9c68e38cbcab-plugins-config-volume\") pod \"2020363f-0618-43ca-a735-9c68e38cbcab\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") "
Jul 29 06:55:49.143875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.143860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vqjm\" (UniqueName: \"kubernetes.io/projected/23be98b6-b064-466e-8227-08c9c138acba-kube-api-access-5vqjm\") pod \"23be98b6-b064-466e-8227-08c9c138acba\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") "
Jul 29 06:55:49.144119 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.143903    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2w7q\" (UniqueName: \"kubernetes.io/projected/2020363f-0618-43ca-a735-9c68e38cbcab-kube-api-access-t2w7q\") pod \"2020363f-0618-43ca-a735-9c68e38cbcab\" (UID: \"2020363f-0618-43ca-a735-9c68e38cbcab\") "
Jul 29 06:55:49.144119 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.143919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23be98b6-b064-466e-8227-08c9c138acba-plugins-config-volume\") pod \"23be98b6-b064-466e-8227-08c9c138acba\" (UID: \"23be98b6-b064-466e-8227-08c9c138acba\") "
Jul 29 06:55:49.144304 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.144270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2020363f-0618-43ca-a735-9c68e38cbcab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2020363f-0618-43ca-a735-9c68e38cbcab" (UID: "2020363f-0618-43ca-a735-9c68e38cbcab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:55:49.144426 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.144396    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23be98b6-b064-466e-8227-08c9c138acba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23be98b6-b064-466e-8227-08c9c138acba" (UID: "23be98b6-b064-466e-8227-08c9c138acba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:55:49.146378 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.146350    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2020363f-0618-43ca-a735-9c68e38cbcab-kube-api-access-t2w7q" (OuterVolumeSpecName: "kube-api-access-t2w7q") pod "2020363f-0618-43ca-a735-9c68e38cbcab" (UID: "2020363f-0618-43ca-a735-9c68e38cbcab"). InnerVolumeSpecName "kube-api-access-t2w7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:55:49.146467 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.146415    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23be98b6-b064-466e-8227-08c9c138acba-kube-api-access-5vqjm" (OuterVolumeSpecName: "kube-api-access-5vqjm") pod "23be98b6-b064-466e-8227-08c9c138acba" (UID: "23be98b6-b064-466e-8227-08c9c138acba"). InnerVolumeSpecName "kube-api-access-5vqjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:55:49.244768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.244701    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2020363f-0618-43ca-a735-9c68e38cbcab-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:49.244768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.244762    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vqjm\" (UniqueName: \"kubernetes.io/projected/23be98b6-b064-466e-8227-08c9c138acba-kube-api-access-5vqjm\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:49.244768 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.244773    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2w7q\" (UniqueName: \"kubernetes.io/projected/2020363f-0618-43ca-a735-9c68e38cbcab-kube-api-access-t2w7q\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:49.245005 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.244782    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23be98b6-b064-466e-8227-08c9c138acba-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:55:49.814581 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.814553    2578 generic.go:356] "Generic (PLEG): container finished" podID="23be98b6-b064-466e-8227-08c9c138acba" containerID="03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16" exitCode=0
Jul 29 06:55:49.815028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.814601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"
Jul 29 06:55:49.815028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.814658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft" event={"ID":"23be98b6-b064-466e-8227-08c9c138acba","Type":"ContainerDied","Data":"03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16"}
Jul 29 06:55:49.815028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.814736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft" event={"ID":"23be98b6-b064-466e-8227-08c9c138acba","Type":"ContainerDied","Data":"28756afa12271c45da4ca12704548888ac4741cae25edaeff721786e1c6a9b2a"}
Jul 29 06:55:49.815028 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.814771    2578 scope.go:117] "RemoveContainer" containerID="03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16"
Jul 29 06:55:49.816306 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.816087    2578 generic.go:356] "Generic (PLEG): container finished" podID="2020363f-0618-43ca-a735-9c68e38cbcab" containerID="0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22" exitCode=0
Jul 29 06:55:49.816306 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.816140    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"
Jul 29 06:55:49.816306 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.816179    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj" event={"ID":"2020363f-0618-43ca-a735-9c68e38cbcab","Type":"ContainerDied","Data":"0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22"}
Jul 29 06:55:49.816306 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.816255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj" event={"ID":"2020363f-0618-43ca-a735-9c68e38cbcab","Type":"ContainerDied","Data":"c4d873a59853fc48d54bda4342432414ccb6ff78b89c116a2f14252c5c55267c"}
Jul 29 06:55:49.826116 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.826098    2578 scope.go:117] "RemoveContainer" containerID="03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16"
Jul 29 06:55:49.826421 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:55:49.826391    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16\": container with ID starting with 03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16 not found: ID does not exist" containerID="03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16"
Jul 29 06:55:49.826525 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.826433    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16"} err="failed to get container status \"03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16\": rpc error: code = NotFound desc = could not find container \"03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16\": container with ID starting with 03734beca123f3f8b98cb9e61f5e6d478f57e8b09ad350752807bdaaeeca0a16 not found: ID does not exist"
Jul 29 06:55:49.826525 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.826459    2578 scope.go:117] "RemoveContainer" containerID="0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22"
Jul 29 06:55:49.835131 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.835113    2578 scope.go:117] "RemoveContainer" containerID="0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22"
Jul 29 06:55:49.835430 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:55:49.835408    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22\": container with ID starting with 0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22 not found: ID does not exist" containerID="0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22"
Jul 29 06:55:49.835514 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.835438    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22"} err="failed to get container status \"0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22\": rpc error: code = NotFound desc = could not find container \"0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22\": container with ID starting with 0acf4c32661cb05e516edeee1d31cf54a48d63d298c675990ae29d8e879d8e22 not found: ID does not exist"
Jul 29 06:55:49.839987 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.839966    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"]
Jul 29 06:55:49.845835 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.845813    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft"]
Jul 29 06:55:49.854684 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.854658    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"]
Jul 29 06:55:49.856846 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:49.856828    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj"]
Jul 29 06:55:50.906208 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:50.906177    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2020363f-0618-43ca-a735-9c68e38cbcab" path="/var/lib/kubelet/pods/2020363f-0618-43ca-a735-9c68e38cbcab/volumes"
Jul 29 06:55:50.906619 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:50.906523    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23be98b6-b064-466e-8227-08c9c138acba" path="/var/lib/kubelet/pods/23be98b6-b064-466e-8227-08c9c138acba/volumes"
Jul 29 06:55:51.805045 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:51.805006    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:55:54.037985 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.037953    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"]
Jul 29 06:55:54.038358 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.038331    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2020363f-0618-43ca-a735-9c68e38cbcab" containerName="payload-pre-processing"
Jul 29 06:55:54.038358 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.038342    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2020363f-0618-43ca-a735-9c68e38cbcab" containerName="payload-pre-processing"
Jul 29 06:55:54.038358 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.038352    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23be98b6-b064-466e-8227-08c9c138acba" containerName="payload-processing"
Jul 29 06:55:54.038358 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.038357    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23be98b6-b064-466e-8227-08c9c138acba" containerName="payload-processing"
Jul 29 06:55:54.038488 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.038440    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2020363f-0618-43ca-a735-9c68e38cbcab" containerName="payload-pre-processing"
Jul 29 06:55:54.038488 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.038447    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23be98b6-b064-466e-8227-08c9c138acba" containerName="payload-processing"
Jul 29 06:55:54.043001 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.042981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.045378 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.045339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0f99172f-dockercfg-776q2\""
Jul 29 06:55:54.045599 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.045577    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0f99172f\""
Jul 29 06:55:54.055488 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.055406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"]
Jul 29 06:55:54.089088 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.089054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwfpd\" (UniqueName: \"kubernetes.io/projected/1740fdd1-af25-4d61-b7b8-4e8da2301af0-kube-api-access-nwfpd\") pod \"payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") " pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.089088 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.089087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fdd1-af25-4d61-b7b8-4e8da2301af0-plugins-config-volume\") pod \"payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") " pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.190212 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.190176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwfpd\" (UniqueName: \"kubernetes.io/projected/1740fdd1-af25-4d61-b7b8-4e8da2301af0-kube-api-access-nwfpd\") pod \"payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") " pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.190212 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.190216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fdd1-af25-4d61-b7b8-4e8da2301af0-plugins-config-volume\") pod \"payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") " pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.191011 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.190991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fdd1-af25-4d61-b7b8-4e8da2301af0-plugins-config-volume\") pod \"payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") " pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.197929 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.197905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwfpd\" (UniqueName: \"kubernetes.io/projected/1740fdd1-af25-4d61-b7b8-4e8da2301af0-kube-api-access-nwfpd\") pod \"payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") " pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.360323 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.360291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.502670 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.502639    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"]
Jul 29 06:55:54.504266 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:55:54.504227    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1740fdd1_af25_4d61_b7b8_4e8da2301af0.slice/crio-29b493c9c177080312ff0d11abe708ed47caa7174d74b1bc134aa95abe592974 WatchSource:0}: Error finding container 29b493c9c177080312ff0d11abe708ed47caa7174d74b1bc134aa95abe592974: Status 404 returned error can't find the container with id 29b493c9c177080312ff0d11abe708ed47caa7174d74b1bc134aa95abe592974
Jul 29 06:55:54.848240 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.848132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd" event={"ID":"1740fdd1-af25-4d61-b7b8-4e8da2301af0","Type":"ContainerStarted","Data":"fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c"}
Jul 29 06:55:54.848240 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.848193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd" event={"ID":"1740fdd1-af25-4d61-b7b8-4e8da2301af0","Type":"ContainerStarted","Data":"29b493c9c177080312ff0d11abe708ed47caa7174d74b1bc134aa95abe592974"}
Jul 29 06:55:54.848240 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.848233    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:55:54.864869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:55:54.864805    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd" podStartSLOduration=0.86478531 podStartE2EDuration="864.78531ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:55:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:55:54.862534018 +0000 UTC m=+1996.498125831" watchObservedRunningTime="2026-07-29 06:55:54.86478531 +0000 UTC m=+1996.500377102"
Jul 29 06:56:02.210591 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:02.210550    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:56:05.857186 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:05.857152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:56:24.012201 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.012165    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"]
Jul 29 06:56:24.012735 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.012388    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd" podUID="1740fdd1-af25-4d61-b7b8-4e8da2301af0" containerName="payload-processing" containerID="cri-o://fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c" gracePeriod=30
Jul 29 06:56:24.288879 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.288845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:56:24.370732 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.370675    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwfpd\" (UniqueName: \"kubernetes.io/projected/1740fdd1-af25-4d61-b7b8-4e8da2301af0-kube-api-access-nwfpd\") pod \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") "
Jul 29 06:56:24.370902 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.370796    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fdd1-af25-4d61-b7b8-4e8da2301af0-plugins-config-volume\") pod \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\" (UID: \"1740fdd1-af25-4d61-b7b8-4e8da2301af0\") "
Jul 29 06:56:24.371151 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.371116    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1740fdd1-af25-4d61-b7b8-4e8da2301af0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1740fdd1-af25-4d61-b7b8-4e8da2301af0" (UID: "1740fdd1-af25-4d61-b7b8-4e8da2301af0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:56:24.373019 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.372998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1740fdd1-af25-4d61-b7b8-4e8da2301af0-kube-api-access-nwfpd" (OuterVolumeSpecName: "kube-api-access-nwfpd") pod "1740fdd1-af25-4d61-b7b8-4e8da2301af0" (UID: "1740fdd1-af25-4d61-b7b8-4e8da2301af0"). InnerVolumeSpecName "kube-api-access-nwfpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:56:24.471482 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.471438    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwfpd\" (UniqueName: \"kubernetes.io/projected/1740fdd1-af25-4d61-b7b8-4e8da2301af0-kube-api-access-nwfpd\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:56:24.471482 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:24.471472    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1740fdd1-af25-4d61-b7b8-4e8da2301af0-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:56:25.029034 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.029003    2578 generic.go:356] "Generic (PLEG): container finished" podID="1740fdd1-af25-4d61-b7b8-4e8da2301af0" containerID="fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c" exitCode=0
Jul 29 06:56:25.029527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.029057    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"
Jul 29 06:56:25.029527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.029089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd" event={"ID":"1740fdd1-af25-4d61-b7b8-4e8da2301af0","Type":"ContainerDied","Data":"fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c"}
Jul 29 06:56:25.029527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.029144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd" event={"ID":"1740fdd1-af25-4d61-b7b8-4e8da2301af0","Type":"ContainerDied","Data":"29b493c9c177080312ff0d11abe708ed47caa7174d74b1bc134aa95abe592974"}
Jul 29 06:56:25.029527 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.029185    2578 scope.go:117] "RemoveContainer" containerID="fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c"
Jul 29 06:56:25.040782 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.040759    2578 scope.go:117] "RemoveContainer" containerID="fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c"
Jul 29 06:56:25.041118 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:56:25.041098    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c\": container with ID starting with fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c not found: ID does not exist" containerID="fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c"
Jul 29 06:56:25.041170 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.041138    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c"} err="failed to get container status \"fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c\": rpc error: code = NotFound desc = could not find container \"fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c\": container with ID starting with fda283fcdf4b2dbcf05a8b924dbf69e28551102497d1960a71d25d5054bf631c not found: ID does not exist"
Jul 29 06:56:25.048616 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.048591    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"]
Jul 29 06:56:25.058126 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:25.058096    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd"]
Jul 29 06:56:26.904584 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:26.904551    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1740fdd1-af25-4d61-b7b8-4e8da2301af0" path="/var/lib/kubelet/pods/1740fdd1-af25-4d61-b7b8-4e8da2301af0/volumes"
Jul 29 06:56:27.805622 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:56:27.805582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:57:38.992861 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:57:38.992830    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:57:38.997627 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:57:38.997599    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:57:39.014385 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:57:39.014358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 06:57:39.018870 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:57:39.018851    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 06:57:50.011749 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:57:50.011693    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:58:02.508085 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:02.508038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:58:13.307764 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:13.307729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:58:17.354145 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.354111    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"]
Jul 29 06:58:17.354544 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.354529    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1740fdd1-af25-4d61-b7b8-4e8da2301af0" containerName="payload-processing"
Jul 29 06:58:17.354593 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.354547    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1740fdd1-af25-4d61-b7b8-4e8da2301af0" containerName="payload-processing"
Jul 29 06:58:17.354628 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.354620    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1740fdd1-af25-4d61-b7b8-4e8da2301af0" containerName="payload-processing"
Jul 29 06:58:17.357958 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.357938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.360376 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.360349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-bc10550f-dockercfg-8hzbn\""
Jul 29 06:58:17.360506 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.360444    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-bc10550f\""
Jul 29 06:58:17.370653 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.370631    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"]
Jul 29 06:58:17.379088 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.379063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78d8h\" (UniqueName: \"kubernetes.io/projected/a2518a76-54f0-4c8a-9d47-a261e7dcf496-kube-api-access-78d8h\") pod \"payload-processing-e2e-mt-bc10550f-858c5684cd-c94db\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") " pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.379269 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.379118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2518a76-54f0-4c8a-9d47-a261e7dcf496-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc10550f-858c5684cd-c94db\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") " pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.479907 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.479864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78d8h\" (UniqueName: \"kubernetes.io/projected/a2518a76-54f0-4c8a-9d47-a261e7dcf496-kube-api-access-78d8h\") pod \"payload-processing-e2e-mt-bc10550f-858c5684cd-c94db\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") " pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.480127 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.479936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2518a76-54f0-4c8a-9d47-a261e7dcf496-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc10550f-858c5684cd-c94db\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") " pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.480585 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.480564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2518a76-54f0-4c8a-9d47-a261e7dcf496-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc10550f-858c5684cd-c94db\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") " pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.487521 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.487493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78d8h\" (UniqueName: \"kubernetes.io/projected/a2518a76-54f0-4c8a-9d47-a261e7dcf496-kube-api-access-78d8h\") pod \"payload-processing-e2e-mt-bc10550f-858c5684cd-c94db\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") " pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.668824 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.668792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:17.813915 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:17.813889    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"]
Jul 29 06:58:17.816327 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:58:17.816303    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2518a76_54f0_4c8a_9d47_a261e7dcf496.slice/crio-2b5082575d9a68107a5219b55ffb1db504c7902b0d11a2e325743c5eb7e7424c WatchSource:0}: Error finding container 2b5082575d9a68107a5219b55ffb1db504c7902b0d11a2e325743c5eb7e7424c: Status 404 returned error can't find the container with id 2b5082575d9a68107a5219b55ffb1db504c7902b0d11a2e325743c5eb7e7424c
Jul 29 06:58:18.676989 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:18.676951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db" event={"ID":"a2518a76-54f0-4c8a-9d47-a261e7dcf496","Type":"ContainerStarted","Data":"058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0"}
Jul 29 06:58:18.677427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:18.677036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db" event={"ID":"a2518a76-54f0-4c8a-9d47-a261e7dcf496","Type":"ContainerStarted","Data":"2b5082575d9a68107a5219b55ffb1db504c7902b0d11a2e325743c5eb7e7424c"}
Jul 29 06:58:18.677427 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:18.677118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:18.696227 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:18.696169    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db" podStartSLOduration=1.6961486959999998 podStartE2EDuration="1.696148696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:58:18.694368737 +0000 UTC m=+2140.329960532" watchObservedRunningTime="2026-07-29 06:58:18.696148696 +0000 UTC m=+2140.331740491"
Jul 29 06:58:23.495350 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:23.495315    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:58:29.684252 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:29.684172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:48.551626 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.551586    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"]
Jul 29 06:58:48.555175 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.555155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:48.557606 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.557586    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 06:58:48.557692 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.557586    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 06:58:48.562296 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.562267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"]
Jul 29 06:58:48.662598 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.662552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58c3f-681a-4f85-9787-f3fb68366147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bc10550f-28z8g\" (UID: \"5fb58c3f-681a-4f85-9787-f3fb68366147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:48.763078 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.763040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58c3f-681a-4f85-9787-f3fb68366147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bc10550f-28z8g\" (UID: \"5fb58c3f-681a-4f85-9787-f3fb68366147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:48.763662 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.763640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58c3f-681a-4f85-9787-f3fb68366147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bc10550f-28z8g\" (UID: \"5fb58c3f-681a-4f85-9787-f3fb68366147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:48.868269 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:48.868236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:49.005565 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:49.005539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"]
Jul 29 06:58:49.008189 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:58:49.008162    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb58c3f_681a_4f85_9787_f3fb68366147.slice/crio-c04f694b7a58d263312b382a2bb1dafb03af5a0c8e3fda60a1a7f17672caa159 WatchSource:0}: Error finding container c04f694b7a58d263312b382a2bb1dafb03af5a0c8e3fda60a1a7f17672caa159: Status 404 returned error can't find the container with id c04f694b7a58d263312b382a2bb1dafb03af5a0c8e3fda60a1a7f17672caa159
Jul 29 06:58:49.856614 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:49.856569    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fb58c3f-681a-4f85-9787-f3fb68366147" containerID="263763ece91f56722f7413500476237c389df9b440aed9a807904a30eb7d34e7" exitCode=0
Jul 29 06:58:49.856614 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:49.856615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g" event={"ID":"5fb58c3f-681a-4f85-9787-f3fb68366147","Type":"ContainerDied","Data":"263763ece91f56722f7413500476237c389df9b440aed9a807904a30eb7d34e7"}
Jul 29 06:58:49.857102 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:49.856666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g" event={"ID":"5fb58c3f-681a-4f85-9787-f3fb68366147","Type":"ContainerStarted","Data":"c04f694b7a58d263312b382a2bb1dafb03af5a0c8e3fda60a1a7f17672caa159"}
Jul 29 06:58:51.001690 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.001664    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:51.186231 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.186139    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58c3f-681a-4f85-9787-f3fb68366147-maas-api-service-ca\") pod \"5fb58c3f-681a-4f85-9787-f3fb68366147\" (UID: \"5fb58c3f-681a-4f85-9787-f3fb68366147\") "
Jul 29 06:58:51.186524 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.186499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fb58c3f-681a-4f85-9787-f3fb68366147-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fb58c3f-681a-4f85-9787-f3fb68366147" (UID: "5fb58c3f-681a-4f85-9787-f3fb68366147"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:58:51.286862 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.286832    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58c3f-681a-4f85-9787-f3fb68366147-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:58:51.868869 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.868835    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"
Jul 29 06:58:51.869045 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.868865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g" event={"ID":"5fb58c3f-681a-4f85-9787-f3fb68366147","Type":"ContainerDied","Data":"c04f694b7a58d263312b382a2bb1dafb03af5a0c8e3fda60a1a7f17672caa159"}
Jul 29 06:58:51.869045 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:51.868913    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c04f694b7a58d263312b382a2bb1dafb03af5a0c8e3fda60a1a7f17672caa159"
Jul 29 06:58:58.984081 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:58.984048    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"]
Jul 29 06:58:58.984552 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:58.984307    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db" podUID="a2518a76-54f0-4c8a-9d47-a261e7dcf496" containerName="payload-processing" containerID="cri-o://058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0" gracePeriod=30
Jul 29 06:58:59.118458 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.118428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"]
Jul 29 06:58:59.120797 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.120770    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc10550f-28z8g"]
Jul 29 06:58:59.253327 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.253302    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:59.360245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.360214    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2518a76-54f0-4c8a-9d47-a261e7dcf496-plugins-config-volume\") pod \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") "
Jul 29 06:58:59.360245 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.360252    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78d8h\" (UniqueName: \"kubernetes.io/projected/a2518a76-54f0-4c8a-9d47-a261e7dcf496-kube-api-access-78d8h\") pod \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\" (UID: \"a2518a76-54f0-4c8a-9d47-a261e7dcf496\") "
Jul 29 06:58:59.360611 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.360592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2518a76-54f0-4c8a-9d47-a261e7dcf496-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a2518a76-54f0-4c8a-9d47-a261e7dcf496" (UID: "a2518a76-54f0-4c8a-9d47-a261e7dcf496"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 06:58:59.362568 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.362544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2518a76-54f0-4c8a-9d47-a261e7dcf496-kube-api-access-78d8h" (OuterVolumeSpecName: "kube-api-access-78d8h") pod "a2518a76-54f0-4c8a-9d47-a261e7dcf496" (UID: "a2518a76-54f0-4c8a-9d47-a261e7dcf496"). InnerVolumeSpecName "kube-api-access-78d8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 06:58:59.461923 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.461882    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2518a76-54f0-4c8a-9d47-a261e7dcf496-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:58:59.461923 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.461920    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78d8h\" (UniqueName: \"kubernetes.io/projected/a2518a76-54f0-4c8a-9d47-a261e7dcf496-kube-api-access-78d8h\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 06:58:59.912688 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.912656    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2518a76-54f0-4c8a-9d47-a261e7dcf496" containerID="058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0" exitCode=0
Jul 29 06:58:59.912875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.912724    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"
Jul 29 06:58:59.912875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.912745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db" event={"ID":"a2518a76-54f0-4c8a-9d47-a261e7dcf496","Type":"ContainerDied","Data":"058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0"}
Jul 29 06:58:59.912875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.912804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db" event={"ID":"a2518a76-54f0-4c8a-9d47-a261e7dcf496","Type":"ContainerDied","Data":"2b5082575d9a68107a5219b55ffb1db504c7902b0d11a2e325743c5eb7e7424c"}
Jul 29 06:58:59.912875 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.912834    2578 scope.go:117] "RemoveContainer" containerID="058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0"
Jul 29 06:58:59.922762 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.922744    2578 scope.go:117] "RemoveContainer" containerID="058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0"
Jul 29 06:58:59.923040 ip-10-0-133-7 kubenswrapper[2578]: E0729 06:58:59.923019    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0\": container with ID starting with 058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0 not found: ID does not exist" containerID="058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0"
Jul 29 06:58:59.923103 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.923051    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0"} err="failed to get container status \"058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0\": rpc error: code = NotFound desc = could not find container \"058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0\": container with ID starting with 058ad1ee6e6d1a53760b3c4ebcd9cbdda1d1c8b3198c983c83bdfee3eb9420f0 not found: ID does not exist"
Jul 29 06:58:59.951299 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.951270    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"]
Jul 29 06:58:59.960765 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:58:59.960731    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db"]
Jul 29 06:59:00.905341 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:00.905310    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fb58c3f-681a-4f85-9787-f3fb68366147" path="/var/lib/kubelet/pods/5fb58c3f-681a-4f85-9787-f3fb68366147/volumes"
Jul 29 06:59:00.905823 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:00.905702    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2518a76-54f0-4c8a-9d47-a261e7dcf496" path="/var/lib/kubelet/pods/a2518a76-54f0-4c8a-9d47-a261e7dcf496/volumes"
Jul 29 06:59:01.799879 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:01.799839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:59:28.568368 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568331    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"]
Jul 29 06:59:28.568795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568688    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2518a76-54f0-4c8a-9d47-a261e7dcf496" containerName="payload-processing"
Jul 29 06:59:28.568795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568699    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2518a76-54f0-4c8a-9d47-a261e7dcf496" containerName="payload-processing"
Jul 29 06:59:28.568795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568751    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb58c3f-681a-4f85-9787-f3fb68366147" containerName="revoke-keys"
Jul 29 06:59:28.568795 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568758    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb58c3f-681a-4f85-9787-f3fb68366147" containerName="revoke-keys"
Jul 29 06:59:28.568930 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568828    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2518a76-54f0-4c8a-9d47-a261e7dcf496" containerName="payload-processing"
Jul 29 06:59:28.568930 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.568837    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb58c3f-681a-4f85-9787-f3fb68366147" containerName="revoke-keys"
Jul 29 06:59:28.574276 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.574257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.576684 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.576655    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-11cbe871\""
Jul 29 06:59:28.577644 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.577621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-11cbe871-dockercfg-lw5tr\""
Jul 29 06:59:28.579488 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.579464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"]
Jul 29 06:59:28.593789 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.593762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"]
Jul 29 06:59:28.598065 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.598049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.604519 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.604496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"]
Jul 29 06:59:28.733750 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.733683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4xw\" (UniqueName: \"kubernetes.io/projected/f015dde1-de19-4e9b-b039-c8fb9489a9fe-kube-api-access-mc4xw\") pod \"payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.733939 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.733759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/084a6307-3744-40d0-b149-88c435f59bb4-plugins-config-volume\") pod \"payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") " pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.733939 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.733798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f015dde1-de19-4e9b-b039-c8fb9489a9fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.733939 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.733828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/084a6307-3744-40d0-b149-88c435f59bb4-kube-api-access-nc7gc\") pod \"payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") " pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.834362 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.834261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/084a6307-3744-40d0-b149-88c435f59bb4-kube-api-access-nc7gc\") pod \"payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") " pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.834362 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.834344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4xw\" (UniqueName: \"kubernetes.io/projected/f015dde1-de19-4e9b-b039-c8fb9489a9fe-kube-api-access-mc4xw\") pod \"payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.834598 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.834383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/084a6307-3744-40d0-b149-88c435f59bb4-plugins-config-volume\") pod \"payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") " pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.834598 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.834427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f015dde1-de19-4e9b-b039-c8fb9489a9fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.835230 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.835205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f015dde1-de19-4e9b-b039-c8fb9489a9fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.835321 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.835205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/084a6307-3744-40d0-b149-88c435f59bb4-plugins-config-volume\") pod \"payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") " pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.842164 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.842139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4xw\" (UniqueName: \"kubernetes.io/projected/f015dde1-de19-4e9b-b039-c8fb9489a9fe-kube-api-access-mc4xw\") pod \"payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.842261 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.842138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/084a6307-3744-40d0-b149-88c435f59bb4-kube-api-access-nc7gc\") pod \"payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") " pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:28.886225 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.886191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:28.909407 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:28.909370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:29.068664 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:29.068637    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"]
Jul 29 06:59:29.070905 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:59:29.070879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084a6307_3744_40d0_b149_88c435f59bb4.slice/crio-cf056b3b301598a034edc196fea78dc9261bd70cf52046f59c18ad3231b22ff3 WatchSource:0}: Error finding container cf056b3b301598a034edc196fea78dc9261bd70cf52046f59c18ad3231b22ff3: Status 404 returned error can't find the container with id cf056b3b301598a034edc196fea78dc9261bd70cf52046f59c18ad3231b22ff3
Jul 29 06:59:29.241945 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:29.241917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"]
Jul 29 06:59:29.243598 ip-10-0-133-7 kubenswrapper[2578]: W0729 06:59:29.243569    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf015dde1_de19_4e9b_b039_c8fb9489a9fe.slice/crio-8779c0e1b02067a8ddf477d299f2a200d86b470f8cbfa445429ad7608efba0f5 WatchSource:0}: Error finding container 8779c0e1b02067a8ddf477d299f2a200d86b470f8cbfa445429ad7608efba0f5: Status 404 returned error can't find the container with id 8779c0e1b02067a8ddf477d299f2a200d86b470f8cbfa445429ad7608efba0f5
Jul 29 06:59:30.082793 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.082756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv" event={"ID":"084a6307-3744-40d0-b149-88c435f59bb4","Type":"ContainerStarted","Data":"18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4"}
Jul 29 06:59:30.083287 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.082819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv" event={"ID":"084a6307-3744-40d0-b149-88c435f59bb4","Type":"ContainerStarted","Data":"cf056b3b301598a034edc196fea78dc9261bd70cf52046f59c18ad3231b22ff3"}
Jul 29 06:59:30.083287 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.082918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:30.084341 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.084318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss" event={"ID":"f015dde1-de19-4e9b-b039-c8fb9489a9fe","Type":"ContainerStarted","Data":"0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed"}
Jul 29 06:59:30.084468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.084359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss" event={"ID":"f015dde1-de19-4e9b-b039-c8fb9489a9fe","Type":"ContainerStarted","Data":"8779c0e1b02067a8ddf477d299f2a200d86b470f8cbfa445429ad7608efba0f5"}
Jul 29 06:59:30.084468 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.084384    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 06:59:30.099838 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.099785    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv" podStartSLOduration=2.099771936 podStartE2EDuration="2.099771936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:59:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:59:30.098877805 +0000 UTC m=+2211.734469594" watchObservedRunningTime="2026-07-29 06:59:30.099771936 +0000 UTC m=+2211.735363754"
Jul 29 06:59:30.115463 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:30.115413    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss" podStartSLOduration=2.115398141 podStartE2EDuration="2.115398141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 06:59:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 06:59:30.114208614 +0000 UTC m=+2211.749800430" watchObservedRunningTime="2026-07-29 06:59:30.115398141 +0000 UTC m=+2211.750989931"
Jul 29 06:59:34.596576 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:34.596538    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 06:59:41.092100 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:41.092070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 06:59:41.092513 ip-10-0-133-7 kubenswrapper[2578]: I0729 06:59:41.092145    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 07:00:08.006164 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:08.006070    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:00:23.107723 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:23.107683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:00:27.256349 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.256313    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"]
Jul 29 07:00:27.259968 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.259947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:27.262168 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.262147    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:00:27.265734 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.262624    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:00:27.272669 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.272641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"]
Jul 29 07:00:27.356044 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.355995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8b7c97-8335-49e6-af27-f0bb6350f0b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11cbe871-vcn47\" (UID: \"6c8b7c97-8335-49e6-af27-f0bb6350f0b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:27.456790 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.456740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8b7c97-8335-49e6-af27-f0bb6350f0b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11cbe871-vcn47\" (UID: \"6c8b7c97-8335-49e6-af27-f0bb6350f0b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:27.457357 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.457336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8b7c97-8335-49e6-af27-f0bb6350f0b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11cbe871-vcn47\" (UID: \"6c8b7c97-8335-49e6-af27-f0bb6350f0b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:27.578517 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.578431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:27.715837 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:27.715806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"]
Jul 29 07:00:27.718408 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:00:27.718378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8b7c97_8335_49e6_af27_f0bb6350f0b4.slice/crio-8891c71501a7c64c053990f51e14b802337568568b470b5b29b4be81e69ffa30 WatchSource:0}: Error finding container 8891c71501a7c64c053990f51e14b802337568568b470b5b29b4be81e69ffa30: Status 404 returned error can't find the container with id 8891c71501a7c64c053990f51e14b802337568568b470b5b29b4be81e69ffa30
Jul 29 07:00:28.409699 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:28.409664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47" event={"ID":"6c8b7c97-8335-49e6-af27-f0bb6350f0b4","Type":"ContainerStarted","Data":"6e8d25c63b4a8c7385c3a9b3712e6ec5cfae500925181f4c3b5ac5bb4af635c8"}
Jul 29 07:00:28.410102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:28.409738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47" event={"ID":"6c8b7c97-8335-49e6-af27-f0bb6350f0b4","Type":"ContainerStarted","Data":"8891c71501a7c64c053990f51e14b802337568568b470b5b29b4be81e69ffa30"}
Jul 29 07:00:28.424323 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:28.424278    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47" podStartSLOduration=1.424263355 podStartE2EDuration="1.424263355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:00:28.422902447 +0000 UTC m=+2270.058494248" watchObservedRunningTime="2026-07-29 07:00:28.424263355 +0000 UTC m=+2270.059855182"
Jul 29 07:00:29.420016 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:29.419977    2578 generic.go:356] "Generic (PLEG): container finished" podID="6c8b7c97-8335-49e6-af27-f0bb6350f0b4" containerID="6e8d25c63b4a8c7385c3a9b3712e6ec5cfae500925181f4c3b5ac5bb4af635c8" exitCode=0
Jul 29 07:00:29.420488 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:29.420061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47" event={"ID":"6c8b7c97-8335-49e6-af27-f0bb6350f0b4","Type":"ContainerDied","Data":"6e8d25c63b4a8c7385c3a9b3712e6ec5cfae500925181f4c3b5ac5bb4af635c8"}
Jul 29 07:00:30.566109 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:30.566082    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:30.581890 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:30.581855    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8b7c97-8335-49e6-af27-f0bb6350f0b4-maas-api-service-ca\") pod \"6c8b7c97-8335-49e6-af27-f0bb6350f0b4\" (UID: \"6c8b7c97-8335-49e6-af27-f0bb6350f0b4\") "
Jul 29 07:00:30.582377 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:30.582350    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8b7c97-8335-49e6-af27-f0bb6350f0b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6c8b7c97-8335-49e6-af27-f0bb6350f0b4" (UID: "6c8b7c97-8335-49e6-af27-f0bb6350f0b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:00:30.683287 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:30.683202    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8b7c97-8335-49e6-af27-f0bb6350f0b4-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:00:31.432557 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:31.432528    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"
Jul 29 07:00:31.432557 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:31.432545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47" event={"ID":"6c8b7c97-8335-49e6-af27-f0bb6350f0b4","Type":"ContainerDied","Data":"8891c71501a7c64c053990f51e14b802337568568b470b5b29b4be81e69ffa30"}
Jul 29 07:00:31.432815 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:31.432589    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8891c71501a7c64c053990f51e14b802337568568b470b5b29b4be81e69ffa30"
Jul 29 07:00:39.114969 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:39.114937    2578 scope.go:117] "RemoveContainer" containerID="4be06fcbca7852d5a9962f1a03e66c09d85d786215073ab6ae68750858d0995d"
Jul 29 07:00:41.499880 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:41.499849    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:00:42.813684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:42.813638    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"]
Jul 29 07:00:42.814079 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:42.813957    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv" podUID="084a6307-3744-40d0-b149-88c435f59bb4" containerName="payload-processing" containerID="cri-o://18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4" gracePeriod=30
Jul 29 07:00:42.818325 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:42.818297    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"]
Jul 29 07:00:42.819146 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:42.819053    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss" podUID="f015dde1-de19-4e9b-b039-c8fb9489a9fe" containerName="payload-pre-processing" containerID="cri-o://0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed" gracePeriod=30
Jul 29 07:00:42.951086 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:42.951047    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"]
Jul 29 07:00:42.954884 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:42.954849    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11cbe871-vcn47"]
Jul 29 07:00:43.097157 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.097132    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 07:00:43.099882 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.099862    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 07:00:43.197604 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.197568    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/084a6307-3744-40d0-b149-88c435f59bb4-kube-api-access-nc7gc\") pod \"084a6307-3744-40d0-b149-88c435f59bb4\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") "
Jul 29 07:00:43.197807 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.197627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/084a6307-3744-40d0-b149-88c435f59bb4-plugins-config-volume\") pod \"084a6307-3744-40d0-b149-88c435f59bb4\" (UID: \"084a6307-3744-40d0-b149-88c435f59bb4\") "
Jul 29 07:00:43.197807 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.197660    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc4xw\" (UniqueName: \"kubernetes.io/projected/f015dde1-de19-4e9b-b039-c8fb9489a9fe-kube-api-access-mc4xw\") pod \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") "
Jul 29 07:00:43.197907 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.197883    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f015dde1-de19-4e9b-b039-c8fb9489a9fe-plugins-config-volume\") pod \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\" (UID: \"f015dde1-de19-4e9b-b039-c8fb9489a9fe\") "
Jul 29 07:00:43.198233 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.198204    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084a6307-3744-40d0-b149-88c435f59bb4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "084a6307-3744-40d0-b149-88c435f59bb4" (UID: "084a6307-3744-40d0-b149-88c435f59bb4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:00:43.198348 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.198261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f015dde1-de19-4e9b-b039-c8fb9489a9fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f015dde1-de19-4e9b-b039-c8fb9489a9fe" (UID: "f015dde1-de19-4e9b-b039-c8fb9489a9fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:00:43.199893 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.199875    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f015dde1-de19-4e9b-b039-c8fb9489a9fe-kube-api-access-mc4xw" (OuterVolumeSpecName: "kube-api-access-mc4xw") pod "f015dde1-de19-4e9b-b039-c8fb9489a9fe" (UID: "f015dde1-de19-4e9b-b039-c8fb9489a9fe"). InnerVolumeSpecName "kube-api-access-mc4xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:00:43.200039 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.200021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084a6307-3744-40d0-b149-88c435f59bb4-kube-api-access-nc7gc" (OuterVolumeSpecName: "kube-api-access-nc7gc") pod "084a6307-3744-40d0-b149-88c435f59bb4" (UID: "084a6307-3744-40d0-b149-88c435f59bb4"). InnerVolumeSpecName "kube-api-access-nc7gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:00:43.299524 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.299487    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/084a6307-3744-40d0-b149-88c435f59bb4-kube-api-access-nc7gc\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:00:43.299524 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.299516    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/084a6307-3744-40d0-b149-88c435f59bb4-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:00:43.299524 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.299526    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc4xw\" (UniqueName: \"kubernetes.io/projected/f015dde1-de19-4e9b-b039-c8fb9489a9fe-kube-api-access-mc4xw\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:00:43.299792 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.299536    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f015dde1-de19-4e9b-b039-c8fb9489a9fe-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:00:43.503811 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.503776    2578 generic.go:356] "Generic (PLEG): container finished" podID="084a6307-3744-40d0-b149-88c435f59bb4" containerID="18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4" exitCode=0
Jul 29 07:00:43.503990 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.503828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"
Jul 29 07:00:43.503990 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.503847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv" event={"ID":"084a6307-3744-40d0-b149-88c435f59bb4","Type":"ContainerDied","Data":"18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4"}
Jul 29 07:00:43.503990 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.503898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv" event={"ID":"084a6307-3744-40d0-b149-88c435f59bb4","Type":"ContainerDied","Data":"cf056b3b301598a034edc196fea78dc9261bd70cf52046f59c18ad3231b22ff3"}
Jul 29 07:00:43.503990 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.503929    2578 scope.go:117] "RemoveContainer" containerID="18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4"
Jul 29 07:00:43.505342 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.505293    2578 generic.go:356] "Generic (PLEG): container finished" podID="f015dde1-de19-4e9b-b039-c8fb9489a9fe" containerID="0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed" exitCode=0
Jul 29 07:00:43.505342 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.505334    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"
Jul 29 07:00:43.505342 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.505397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss" event={"ID":"f015dde1-de19-4e9b-b039-c8fb9489a9fe","Type":"ContainerDied","Data":"0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed"}
Jul 29 07:00:43.505795 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.505438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss" event={"ID":"f015dde1-de19-4e9b-b039-c8fb9489a9fe","Type":"ContainerDied","Data":"8779c0e1b02067a8ddf477d299f2a200d86b470f8cbfa445429ad7608efba0f5"}
Jul 29 07:00:43.514382 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.514361    2578 scope.go:117] "RemoveContainer" containerID="18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4"
Jul 29 07:00:43.514675 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:00:43.514657    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4\": container with ID starting with 18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4 not found: ID does not exist" containerID="18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4"
Jul 29 07:00:43.514808 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.514684    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4"} err="failed to get container status \"18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4\": rpc error: code = NotFound desc = could not find container \"18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4\": container with ID starting with 18b046537aeb50cbfe903ea74374aa2af31a31b0a26e7b9f8535ad22282cfdf4 not found: ID does not exist"
Jul 29 07:00:43.514808 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.514703    2578 scope.go:117] "RemoveContainer" containerID="0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed"
Jul 29 07:00:43.523608 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.523593    2578 scope.go:117] "RemoveContainer" containerID="0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed"
Jul 29 07:00:43.523881 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:00:43.523862    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed\": container with ID starting with 0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed not found: ID does not exist" containerID="0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed"
Jul 29 07:00:43.523951 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.523891    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed"} err="failed to get container status \"0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed\": rpc error: code = NotFound desc = could not find container \"0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed\": container with ID starting with 0183a05ca3a93d70eb03ae103148d5a166c5f8252bd4aa89228379a902b409ed not found: ID does not exist"
Jul 29 07:00:43.529047 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.529023    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"]
Jul 29 07:00:43.531304 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.531287    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss"]
Jul 29 07:00:43.539897 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.539879    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"]
Jul 29 07:00:43.543506 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:43.543487    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv"]
Jul 29 07:00:44.905165 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:44.905132    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084a6307-3744-40d0-b149-88c435f59bb4" path="/var/lib/kubelet/pods/084a6307-3744-40d0-b149-88c435f59bb4/volumes"
Jul 29 07:00:44.905554 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:44.905463    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8b7c97-8335-49e6-af27-f0bb6350f0b4" path="/var/lib/kubelet/pods/6c8b7c97-8335-49e6-af27-f0bb6350f0b4/volumes"
Jul 29 07:00:44.905800 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:44.905787    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f015dde1-de19-4e9b-b039-c8fb9489a9fe" path="/var/lib/kubelet/pods/f015dde1-de19-4e9b-b039-c8fb9489a9fe/volumes"
Jul 29 07:00:52.306473 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:00:52.306436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:01:37.521895 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:01:37.521809    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:01:39.136076 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:01:39.136046    2578 scope.go:117] "RemoveContainer" containerID="1dcb71a83d095dedb7afcc18024fb13960836170b26d3dc12ae71612142051e6"
Jul 29 07:01:49.705958 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:01:49.705921    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:02:32.423086 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423048    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"]
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423461    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f015dde1-de19-4e9b-b039-c8fb9489a9fe" containerName="payload-pre-processing"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423474    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f015dde1-de19-4e9b-b039-c8fb9489a9fe" containerName="payload-pre-processing"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423484    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8b7c97-8335-49e6-af27-f0bb6350f0b4" containerName="revoke-keys"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423489    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8b7c97-8335-49e6-af27-f0bb6350f0b4" containerName="revoke-keys"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423504    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084a6307-3744-40d0-b149-88c435f59bb4" containerName="payload-processing"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423512    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="084a6307-3744-40d0-b149-88c435f59bb4" containerName="payload-processing"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423576    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f015dde1-de19-4e9b-b039-c8fb9489a9fe" containerName="payload-pre-processing"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423585    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c8b7c97-8335-49e6-af27-f0bb6350f0b4" containerName="revoke-keys"
Jul 29 07:02:32.423598 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.423594    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="084a6307-3744-40d0-b149-88c435f59bb4" containerName="payload-processing"
Jul 29 07:02:32.426969 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.426953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.429390 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.429361    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-dd1393\""
Jul 29 07:02:32.438047 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.438021    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"]
Jul 29 07:02:32.467316 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.467282    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"]
Jul 29 07:02:32.470650 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.470632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.473660 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.473638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-dd1393-dockercfg-fwf9n\""
Jul 29 07:02:32.483038 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.483010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"]
Jul 29 07:02:32.592649 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.592612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbad250-b44d-4723-81e7-2c44a23832d8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.592847 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.592665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdqx\" (UniqueName: \"kubernetes.io/projected/fcbad250-b44d-4723-81e7-2c44a23832d8-kube-api-access-ttdqx\") pod \"payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.592847 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.592686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7277a18-5bad-4098-aa74-708030b408c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.592847 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.592784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q66h9\" (UniqueName: \"kubernetes.io/projected/a7277a18-5bad-4098-aa74-708030b408c1-kube-api-access-q66h9\") pod \"payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.694294 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.694206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbad250-b44d-4723-81e7-2c44a23832d8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.694294 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.694256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdqx\" (UniqueName: \"kubernetes.io/projected/fcbad250-b44d-4723-81e7-2c44a23832d8-kube-api-access-ttdqx\") pod \"payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.694294 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.694283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7277a18-5bad-4098-aa74-708030b408c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.694541 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.694330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q66h9\" (UniqueName: \"kubernetes.io/projected/a7277a18-5bad-4098-aa74-708030b408c1-kube-api-access-q66h9\") pod \"payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.695231 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.695205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7277a18-5bad-4098-aa74-708030b408c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.695322 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.695205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbad250-b44d-4723-81e7-2c44a23832d8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.702478 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.702454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdqx\" (UniqueName: \"kubernetes.io/projected/fcbad250-b44d-4723-81e7-2c44a23832d8-kube-api-access-ttdqx\") pod \"payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.702572 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.702503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q66h9\" (UniqueName: \"kubernetes.io/projected/a7277a18-5bad-4098-aa74-708030b408c1-kube-api-access-q66h9\") pod \"payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.739680 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.739644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:32.781108 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.781072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:32.907913 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:02:32.905051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7277a18_5bad_4098_aa74_708030b408c1.slice/crio-f45f2003605ef10b06dbef4ebe55171b64b06264645880b5cfdb15bcb3209975 WatchSource:0}: Error finding container f45f2003605ef10b06dbef4ebe55171b64b06264645880b5cfdb15bcb3209975: Status 404 returned error can't find the container with id f45f2003605ef10b06dbef4ebe55171b64b06264645880b5cfdb15bcb3209975
Jul 29 07:02:32.911562 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.911540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"]
Jul 29 07:02:32.935148 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:32.935121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"]
Jul 29 07:02:32.939792 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:02:32.939765    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbad250_b44d_4723_81e7_2c44a23832d8.slice/crio-207ebf87b1dbb8cd478e89b190bcdd98cc97b677afda70f33906c91b02466d5c WatchSource:0}: Error finding container 207ebf87b1dbb8cd478e89b190bcdd98cc97b677afda70f33906c91b02466d5c: Status 404 returned error can't find the container with id 207ebf87b1dbb8cd478e89b190bcdd98cc97b677afda70f33906c91b02466d5c
Jul 29 07:02:33.139787 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.139748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7" event={"ID":"a7277a18-5bad-4098-aa74-708030b408c1","Type":"ContainerStarted","Data":"659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1"}
Jul 29 07:02:33.139986 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.139806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:02:33.139986 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.139830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7" event={"ID":"a7277a18-5bad-4098-aa74-708030b408c1","Type":"ContainerStarted","Data":"f45f2003605ef10b06dbef4ebe55171b64b06264645880b5cfdb15bcb3209975"}
Jul 29 07:02:33.141190 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.141166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx" event={"ID":"fcbad250-b44d-4723-81e7-2c44a23832d8","Type":"ContainerStarted","Data":"5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1"}
Jul 29 07:02:33.141326 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.141203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx" event={"ID":"fcbad250-b44d-4723-81e7-2c44a23832d8","Type":"ContainerStarted","Data":"207ebf87b1dbb8cd478e89b190bcdd98cc97b677afda70f33906c91b02466d5c"}
Jul 29 07:02:33.141326 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.141287    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:33.155857 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.155794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7" podStartSLOduration=1.155775539 podStartE2EDuration="1.155775539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:02:33.154673982 +0000 UTC m=+2394.790265786" watchObservedRunningTime="2026-07-29 07:02:33.155775539 +0000 UTC m=+2394.791367331"
Jul 29 07:02:33.171005 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:33.170954    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx" podStartSLOduration=1.170936928 podStartE2EDuration="1.170936928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:02:33.169563012 +0000 UTC m=+2394.805154802" watchObservedRunningTime="2026-07-29 07:02:33.170936928 +0000 UTC m=+2394.806528718"
Jul 29 07:02:37.809634 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:37.809597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:02:39.036516 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:39.036487    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:02:39.040850 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:39.040826    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:02:39.054003 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:39.053982    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:02:39.059181 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:39.059163    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:02:44.149699 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:44.149666    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:02:44.150102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:02:44.149856    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:03:00.513979 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.513903    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"]
Jul 29 07:03:00.517593 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.517576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.519905 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.519885    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-9aa496\""
Jul 29 07:03:00.527429 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.527402    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"]
Jul 29 07:03:00.569101 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.569068    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"]
Jul 29 07:03:00.572763 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.572741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.575179 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.575159    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-9aa496-dockercfg-w5c6t\""
Jul 29 07:03:00.583029 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.583003    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"]
Jul 29 07:03:00.643108 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.643073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaa1695f-5341-4b6d-9749-615b87793a92-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.643282 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.643140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6jf\" (UniqueName: \"kubernetes.io/projected/aaa1695f-5341-4b6d-9749-615b87793a92-kube-api-access-cv6jf\") pod \"payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.643282 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.643199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.643282 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.643261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7mqx\" (UniqueName: \"kubernetes.io/projected/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-kube-api-access-w7mqx\") pod \"payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.744645 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.744605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.744645 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.744646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7mqx\" (UniqueName: \"kubernetes.io/projected/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-kube-api-access-w7mqx\") pod \"payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.744908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.744803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaa1695f-5341-4b6d-9749-615b87793a92-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.744908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.744887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6jf\" (UniqueName: \"kubernetes.io/projected/aaa1695f-5341-4b6d-9749-615b87793a92-kube-api-access-cv6jf\") pod \"payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.745508 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.745486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaa1695f-5341-4b6d-9749-615b87793a92-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.745599 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.745487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.752883 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.752857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6jf\" (UniqueName: \"kubernetes.io/projected/aaa1695f-5341-4b6d-9749-615b87793a92-kube-api-access-cv6jf\") pod \"payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:00.753000 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.752949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7mqx\" (UniqueName: \"kubernetes.io/projected/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-kube-api-access-w7mqx\") pod \"payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.829898 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.829808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:00.884948 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:00.884527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:01.007684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.007658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"]
Jul 29 07:03:01.009913 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:03:01.009889    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3bd9c8_9fd6_40fd_973a_301c84d71ceb.slice/crio-8c8932d8aa42e82b94b417fefaf7cc87d983fff8229fc1862de9321256e8da6f WatchSource:0}: Error finding container 8c8932d8aa42e82b94b417fefaf7cc87d983fff8229fc1862de9321256e8da6f: Status 404 returned error can't find the container with id 8c8932d8aa42e82b94b417fefaf7cc87d983fff8229fc1862de9321256e8da6f
Jul 29 07:03:01.054851 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:03:01.054809    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa1695f_5341_4b6d_9749_615b87793a92.slice/crio-f740d7ff562495f69b31e346bf29898d4c72a6e1f354ad9edd0a18426371d7f9 WatchSource:0}: Error finding container f740d7ff562495f69b31e346bf29898d4c72a6e1f354ad9edd0a18426371d7f9: Status 404 returned error can't find the container with id f740d7ff562495f69b31e346bf29898d4c72a6e1f354ad9edd0a18426371d7f9
Jul 29 07:03:01.055590 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.055570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"]
Jul 29 07:03:01.305030 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.304992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p" event={"ID":"aaa1695f-5341-4b6d-9749-615b87793a92","Type":"ContainerStarted","Data":"b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0"}
Jul 29 07:03:01.305222 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.305055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:01.305222 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.305082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p" event={"ID":"aaa1695f-5341-4b6d-9749-615b87793a92","Type":"ContainerStarted","Data":"f740d7ff562495f69b31e346bf29898d4c72a6e1f354ad9edd0a18426371d7f9"}
Jul 29 07:03:01.306542 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.306516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh" event={"ID":"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb","Type":"ContainerStarted","Data":"410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe"}
Jul 29 07:03:01.306666 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.306563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh" event={"ID":"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb","Type":"ContainerStarted","Data":"8c8932d8aa42e82b94b417fefaf7cc87d983fff8229fc1862de9321256e8da6f"}
Jul 29 07:03:01.306666 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.306589    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:01.321868 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.321819    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p" podStartSLOduration=1.32180513 podStartE2EDuration="1.32180513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:03:01.319449731 +0000 UTC m=+2422.955041516" watchObservedRunningTime="2026-07-29 07:03:01.32180513 +0000 UTC m=+2422.957396915"
Jul 29 07:03:01.335659 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:01.335613    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh" podStartSLOduration=1.335597993 podStartE2EDuration="1.335597993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:03:01.33318048 +0000 UTC m=+2422.968772276" watchObservedRunningTime="2026-07-29 07:03:01.335597993 +0000 UTC m=+2422.971189784"
Jul 29 07:03:07.405111 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:07.405076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:03:12.314661 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:12.314626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:03:12.315060 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:12.314696    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:03:45.404805 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:45.404766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:03:56.697684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:03:56.697647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:04:16.698419 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:04:16.698386    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:05:10.949189 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:10.949103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"]
Jul 29 07:05:10.953211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:10.953184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:10.957387 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:10.956663    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:05:10.957387 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:10.956679    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:05:10.959407 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:10.959383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"]
Jul 29 07:05:11.103354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:11.103310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a59660c-fdcd-4595-b5b3-3539361d58f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dd1393-746l2\" (UID: \"2a59660c-fdcd-4595-b5b3-3539361d58f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:11.204783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:11.204673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a59660c-fdcd-4595-b5b3-3539361d58f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dd1393-746l2\" (UID: \"2a59660c-fdcd-4595-b5b3-3539361d58f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:11.205304 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:11.205284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a59660c-fdcd-4595-b5b3-3539361d58f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dd1393-746l2\" (UID: \"2a59660c-fdcd-4595-b5b3-3539361d58f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:11.266699 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:11.266668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:11.412866 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:11.412840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"]
Jul 29 07:05:11.414404 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:05:11.414380    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a59660c_fdcd_4595_b5b3_3539361d58f6.slice/crio-8481fa3e3b51a7f09a55fc8fa9ceb11133457855f62f584ae93a0c596b3ceb9c WatchSource:0}: Error finding container 8481fa3e3b51a7f09a55fc8fa9ceb11133457855f62f584ae93a0c596b3ceb9c: Status 404 returned error can't find the container with id 8481fa3e3b51a7f09a55fc8fa9ceb11133457855f62f584ae93a0c596b3ceb9c
Jul 29 07:05:12.061911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:12.061811    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2" event={"ID":"2a59660c-fdcd-4595-b5b3-3539361d58f6","Type":"ContainerStarted","Data":"fd2a343dbe3d5001b67d433b3f15b392e0c09babdabc77957b42d9f006d9d3da"}
Jul 29 07:05:12.061911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:12.061866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2" event={"ID":"2a59660c-fdcd-4595-b5b3-3539361d58f6","Type":"ContainerStarted","Data":"8481fa3e3b51a7f09a55fc8fa9ceb11133457855f62f584ae93a0c596b3ceb9c"}
Jul 29 07:05:12.078158 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:12.078109    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2" podStartSLOduration=2.078094834 podStartE2EDuration="2.078094834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:05:12.076608559 +0000 UTC m=+2553.712200351" watchObservedRunningTime="2026-07-29 07:05:12.078094834 +0000 UTC m=+2553.713686603"
Jul 29 07:05:13.069756 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:13.069700    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a59660c-fdcd-4595-b5b3-3539361d58f6" containerID="fd2a343dbe3d5001b67d433b3f15b392e0c09babdabc77957b42d9f006d9d3da" exitCode=0
Jul 29 07:05:13.069756 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:13.069749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2" event={"ID":"2a59660c-fdcd-4595-b5b3-3539361d58f6","Type":"ContainerDied","Data":"fd2a343dbe3d5001b67d433b3f15b392e0c09babdabc77957b42d9f006d9d3da"}
Jul 29 07:05:14.219413 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:14.219386    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:14.229194 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:14.229170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a59660c-fdcd-4595-b5b3-3539361d58f6-maas-api-service-ca\") pod \"2a59660c-fdcd-4595-b5b3-3539361d58f6\" (UID: \"2a59660c-fdcd-4595-b5b3-3539361d58f6\") "
Jul 29 07:05:14.229506 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:14.229484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a59660c-fdcd-4595-b5b3-3539361d58f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a59660c-fdcd-4595-b5b3-3539361d58f6" (UID: "2a59660c-fdcd-4595-b5b3-3539361d58f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:05:14.330337 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:14.330251    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a59660c-fdcd-4595-b5b3-3539361d58f6-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:14.905744 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:14.905702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:05:15.085357 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:15.085329    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"
Jul 29 07:05:15.085532 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:15.085376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2" event={"ID":"2a59660c-fdcd-4595-b5b3-3539361d58f6","Type":"ContainerDied","Data":"8481fa3e3b51a7f09a55fc8fa9ceb11133457855f62f584ae93a0c596b3ceb9c"}
Jul 29 07:05:15.085532 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:15.085439    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8481fa3e3b51a7f09a55fc8fa9ceb11133457855f62f584ae93a0c596b3ceb9c"
Jul 29 07:05:21.395210 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.395174    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"]
Jul 29 07:05:21.395799 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.395422    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx" podUID="fcbad250-b44d-4723-81e7-2c44a23832d8" containerName="payload-processing" containerID="cri-o://5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1" gracePeriod=30
Jul 29 07:05:21.405620 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.405586    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"]
Jul 29 07:05:21.405889 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.405841    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7" podUID="a7277a18-5bad-4098-aa74-708030b408c1" containerName="payload-pre-processing" containerID="cri-o://659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1" gracePeriod=30
Jul 29 07:05:21.552803 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.552738    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"]
Jul 29 07:05:21.557747 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.557661    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dd1393-746l2"]
Jul 29 07:05:21.702402 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.702379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:05:21.705233 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.705214    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:05:21.799371 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.799342    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttdqx\" (UniqueName: \"kubernetes.io/projected/fcbad250-b44d-4723-81e7-2c44a23832d8-kube-api-access-ttdqx\") pod \"fcbad250-b44d-4723-81e7-2c44a23832d8\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") "
Jul 29 07:05:21.799371 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.799384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7277a18-5bad-4098-aa74-708030b408c1-plugins-config-volume\") pod \"a7277a18-5bad-4098-aa74-708030b408c1\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") "
Jul 29 07:05:21.799586 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.799454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbad250-b44d-4723-81e7-2c44a23832d8-plugins-config-volume\") pod \"fcbad250-b44d-4723-81e7-2c44a23832d8\" (UID: \"fcbad250-b44d-4723-81e7-2c44a23832d8\") "
Jul 29 07:05:21.799586 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.799485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q66h9\" (UniqueName: \"kubernetes.io/projected/a7277a18-5bad-4098-aa74-708030b408c1-kube-api-access-q66h9\") pod \"a7277a18-5bad-4098-aa74-708030b408c1\" (UID: \"a7277a18-5bad-4098-aa74-708030b408c1\") "
Jul 29 07:05:21.799885 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.799860    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbad250-b44d-4723-81e7-2c44a23832d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fcbad250-b44d-4723-81e7-2c44a23832d8" (UID: "fcbad250-b44d-4723-81e7-2c44a23832d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:05:21.799885 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.799860    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7277a18-5bad-4098-aa74-708030b408c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a7277a18-5bad-4098-aa74-708030b408c1" (UID: "a7277a18-5bad-4098-aa74-708030b408c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:05:21.801693 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.801673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcbad250-b44d-4723-81e7-2c44a23832d8-kube-api-access-ttdqx" (OuterVolumeSpecName: "kube-api-access-ttdqx") pod "fcbad250-b44d-4723-81e7-2c44a23832d8" (UID: "fcbad250-b44d-4723-81e7-2c44a23832d8"). InnerVolumeSpecName "kube-api-access-ttdqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:05:21.801774 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.801745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7277a18-5bad-4098-aa74-708030b408c1-kube-api-access-q66h9" (OuterVolumeSpecName: "kube-api-access-q66h9") pod "a7277a18-5bad-4098-aa74-708030b408c1" (UID: "a7277a18-5bad-4098-aa74-708030b408c1"). InnerVolumeSpecName "kube-api-access-q66h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:05:21.900804 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.900768    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7277a18-5bad-4098-aa74-708030b408c1-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:21.900804 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.900796    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbad250-b44d-4723-81e7-2c44a23832d8-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:21.900804 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.900808    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q66h9\" (UniqueName: \"kubernetes.io/projected/a7277a18-5bad-4098-aa74-708030b408c1-kube-api-access-q66h9\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:21.901032 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:21.900817    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttdqx\" (UniqueName: \"kubernetes.io/projected/fcbad250-b44d-4723-81e7-2c44a23832d8-kube-api-access-ttdqx\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:22.123973 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.123938    2578 generic.go:356] "Generic (PLEG): container finished" podID="fcbad250-b44d-4723-81e7-2c44a23832d8" containerID="5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1" exitCode=0
Jul 29 07:05:22.124153 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.123983    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"
Jul 29 07:05:22.124153 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.124034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx" event={"ID":"fcbad250-b44d-4723-81e7-2c44a23832d8","Type":"ContainerDied","Data":"5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1"}
Jul 29 07:05:22.124153 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.124086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx" event={"ID":"fcbad250-b44d-4723-81e7-2c44a23832d8","Type":"ContainerDied","Data":"207ebf87b1dbb8cd478e89b190bcdd98cc97b677afda70f33906c91b02466d5c"}
Jul 29 07:05:22.124153 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.124119    2578 scope.go:117] "RemoveContainer" containerID="5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1"
Jul 29 07:05:22.125482 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.125461    2578 generic.go:356] "Generic (PLEG): container finished" podID="a7277a18-5bad-4098-aa74-708030b408c1" containerID="659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1" exitCode=0
Jul 29 07:05:22.125591 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.125508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"
Jul 29 07:05:22.125591 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.125546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7" event={"ID":"a7277a18-5bad-4098-aa74-708030b408c1","Type":"ContainerDied","Data":"659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1"}
Jul 29 07:05:22.125674 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.125606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7" event={"ID":"a7277a18-5bad-4098-aa74-708030b408c1","Type":"ContainerDied","Data":"f45f2003605ef10b06dbef4ebe55171b64b06264645880b5cfdb15bcb3209975"}
Jul 29 07:05:22.135585 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.135567    2578 scope.go:117] "RemoveContainer" containerID="5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1"
Jul 29 07:05:22.135870 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:05:22.135851    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1\": container with ID starting with 5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1 not found: ID does not exist" containerID="5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1"
Jul 29 07:05:22.135925 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.135878    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1"} err="failed to get container status \"5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1\": rpc error: code = NotFound desc = could not find container \"5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1\": container with ID starting with 5e7de28a4c0bfe7f6fde69cdb4525c68796abb99676f8a8baab67643d81c7af1 not found: ID does not exist"
Jul 29 07:05:22.135925 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.135894    2578 scope.go:117] "RemoveContainer" containerID="659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1"
Jul 29 07:05:22.144754 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.144738    2578 scope.go:117] "RemoveContainer" containerID="659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1"
Jul 29 07:05:22.145044 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:05:22.145021    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1\": container with ID starting with 659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1 not found: ID does not exist" containerID="659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1"
Jul 29 07:05:22.145130 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.145052    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1"} err="failed to get container status \"659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1\": rpc error: code = NotFound desc = could not find container \"659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1\": container with ID starting with 659022d6a03943862577933f96bce5c09c0877de8fb24713689f864eef4c68c1 not found: ID does not exist"
Jul 29 07:05:22.146112 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.146095    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"]
Jul 29 07:05:22.151771 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.151695    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx"]
Jul 29 07:05:22.167942 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.167918    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"]
Jul 29 07:05:22.170081 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.170060    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7"]
Jul 29 07:05:22.904955 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.904922    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a59660c-fdcd-4595-b5b3-3539361d58f6" path="/var/lib/kubelet/pods/2a59660c-fdcd-4595-b5b3-3539361d58f6/volumes"
Jul 29 07:05:22.905321 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.905307    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7277a18-5bad-4098-aa74-708030b408c1" path="/var/lib/kubelet/pods/a7277a18-5bad-4098-aa74-708030b408c1/volumes"
Jul 29 07:05:22.905631 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:22.905620    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcbad250-b44d-4723-81e7-2c44a23832d8" path="/var/lib/kubelet/pods/fcbad250-b44d-4723-81e7-2c44a23832d8/volumes"
Jul 29 07:05:29.911882 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:29.911850    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:05:38.508547 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.508506    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"]
Jul 29 07:05:38.509093 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.508817    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p" podUID="aaa1695f-5341-4b6d-9749-615b87793a92" containerName="payload-processing" containerID="cri-o://b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0" gracePeriod=30
Jul 29 07:05:38.514206 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.514153    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"]
Jul 29 07:05:38.514675 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.514647    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh" podUID="0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" containerName="payload-pre-processing" containerID="cri-o://410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe" gracePeriod=30
Jul 29 07:05:38.813035 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.813014    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:05:38.815518 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.815493    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:05:38.958366 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.958340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7mqx\" (UniqueName: \"kubernetes.io/projected/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-kube-api-access-w7mqx\") pod \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") "
Jul 29 07:05:38.958542 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.958388    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaa1695f-5341-4b6d-9749-615b87793a92-plugins-config-volume\") pod \"aaa1695f-5341-4b6d-9749-615b87793a92\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") "
Jul 29 07:05:38.958542 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.958425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-plugins-config-volume\") pod \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\" (UID: \"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb\") "
Jul 29 07:05:38.958542 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.958485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv6jf\" (UniqueName: \"kubernetes.io/projected/aaa1695f-5341-4b6d-9749-615b87793a92-kube-api-access-cv6jf\") pod \"aaa1695f-5341-4b6d-9749-615b87793a92\" (UID: \"aaa1695f-5341-4b6d-9749-615b87793a92\") "
Jul 29 07:05:38.958880 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.958855    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa1695f-5341-4b6d-9749-615b87793a92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aaa1695f-5341-4b6d-9749-615b87793a92" (UID: "aaa1695f-5341-4b6d-9749-615b87793a92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:05:38.958999 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.958872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" (UID: "0a3bd9c8-9fd6-40fd-973a-301c84d71ceb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:05:38.960684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.960656    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-kube-api-access-w7mqx" (OuterVolumeSpecName: "kube-api-access-w7mqx") pod "0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" (UID: "0a3bd9c8-9fd6-40fd-973a-301c84d71ceb"). InnerVolumeSpecName "kube-api-access-w7mqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:05:38.960807 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:38.960687    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa1695f-5341-4b6d-9749-615b87793a92-kube-api-access-cv6jf" (OuterVolumeSpecName: "kube-api-access-cv6jf") pod "aaa1695f-5341-4b6d-9749-615b87793a92" (UID: "aaa1695f-5341-4b6d-9749-615b87793a92"). InnerVolumeSpecName "kube-api-access-cv6jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:05:39.059749 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.059651    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7mqx\" (UniqueName: \"kubernetes.io/projected/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-kube-api-access-w7mqx\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:39.059749 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.059678    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaa1695f-5341-4b6d-9749-615b87793a92-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:39.059749 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.059692    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:39.059749 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.059705    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv6jf\" (UniqueName: \"kubernetes.io/projected/aaa1695f-5341-4b6d-9749-615b87793a92-kube-api-access-cv6jf\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:05:39.202854 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.198761    2578 scope.go:117] "RemoveContainer" containerID="263763ece91f56722f7413500476237c389df9b440aed9a807904a30eb7d34e7"
Jul 29 07:05:39.233862 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.233836    2578 generic.go:356] "Generic (PLEG): container finished" podID="0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" containerID="410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe" exitCode=0
Jul 29 07:05:39.233985 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.233906    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"
Jul 29 07:05:39.233985 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.233918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh" event={"ID":"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb","Type":"ContainerDied","Data":"410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe"}
Jul 29 07:05:39.234095 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.234001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh" event={"ID":"0a3bd9c8-9fd6-40fd-973a-301c84d71ceb","Type":"ContainerDied","Data":"8c8932d8aa42e82b94b417fefaf7cc87d983fff8229fc1862de9321256e8da6f"}
Jul 29 07:05:39.234095 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.234035    2578 scope.go:117] "RemoveContainer" containerID="410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe"
Jul 29 07:05:39.235310 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.235286    2578 generic.go:356] "Generic (PLEG): container finished" podID="aaa1695f-5341-4b6d-9749-615b87793a92" containerID="b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0" exitCode=0
Jul 29 07:05:39.235417 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.235316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p" event={"ID":"aaa1695f-5341-4b6d-9749-615b87793a92","Type":"ContainerDied","Data":"b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0"}
Jul 29 07:05:39.235417 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.235343    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"
Jul 29 07:05:39.235417 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.235370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p" event={"ID":"aaa1695f-5341-4b6d-9749-615b87793a92","Type":"ContainerDied","Data":"f740d7ff562495f69b31e346bf29898d4c72a6e1f354ad9edd0a18426371d7f9"}
Jul 29 07:05:39.242255 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.242235    2578 scope.go:117] "RemoveContainer" containerID="410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe"
Jul 29 07:05:39.242638 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:05:39.242547    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe\": container with ID starting with 410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe not found: ID does not exist" containerID="410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe"
Jul 29 07:05:39.242638 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.242572    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe"} err="failed to get container status \"410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe\": rpc error: code = NotFound desc = could not find container \"410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe\": container with ID starting with 410ccbc0245d851b9afc07ff99761941580f50afb833d9199fba46f401142ffe not found: ID does not exist"
Jul 29 07:05:39.242638 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.242590    2578 scope.go:117] "RemoveContainer" containerID="b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0"
Jul 29 07:05:39.251257 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.251237    2578 scope.go:117] "RemoveContainer" containerID="b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0"
Jul 29 07:05:39.251554 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:05:39.251534    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0\": container with ID starting with b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0 not found: ID does not exist" containerID="b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0"
Jul 29 07:05:39.251619 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.251563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0"} err="failed to get container status \"b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0\": rpc error: code = NotFound desc = could not find container \"b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0\": container with ID starting with b5b23a1e9195cf3b4e589b91b9878497d3241182562fc6247c38cda3f6f1ead0 not found: ID does not exist"
Jul 29 07:05:39.258284 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.258264    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"]
Jul 29 07:05:39.261354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.261330    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p"]
Jul 29 07:05:39.272935 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.272919    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"]
Jul 29 07:05:39.275867 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:39.275848    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh"]
Jul 29 07:05:40.903806 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:40.903776    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" path="/var/lib/kubelet/pods/0a3bd9c8-9fd6-40fd-973a-301c84d71ceb/volumes"
Jul 29 07:05:40.904293 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:40.904275    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa1695f-5341-4b6d-9749-615b87793a92" path="/var/lib/kubelet/pods/aaa1695f-5341-4b6d-9749-615b87793a92/volumes"
Jul 29 07:05:41.400899 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:41.400860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:05:49.295008 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.294975    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"]
Jul 29 07:05:49.295368 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295353    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" containerName="payload-pre-processing"
Jul 29 07:05:49.295410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295370    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" containerName="payload-pre-processing"
Jul 29 07:05:49.295410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295385    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa1695f-5341-4b6d-9749-615b87793a92" containerName="payload-processing"
Jul 29 07:05:49.295410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295390    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa1695f-5341-4b6d-9749-615b87793a92" containerName="payload-processing"
Jul 29 07:05:49.295410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295398    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a59660c-fdcd-4595-b5b3-3539361d58f6" containerName="revoke-keys"
Jul 29 07:05:49.295410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295403    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a59660c-fdcd-4595-b5b3-3539361d58f6" containerName="revoke-keys"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295418    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7277a18-5bad-4098-aa74-708030b408c1" containerName="payload-pre-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295424    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7277a18-5bad-4098-aa74-708030b408c1" containerName="payload-pre-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295436    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcbad250-b44d-4723-81e7-2c44a23832d8" containerName="payload-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295444    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcbad250-b44d-4723-81e7-2c44a23832d8" containerName="payload-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295502    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa1695f-5341-4b6d-9749-615b87793a92" containerName="payload-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295513    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7277a18-5bad-4098-aa74-708030b408c1" containerName="payload-pre-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295524    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3bd9c8-9fd6-40fd-973a-301c84d71ceb" containerName="payload-pre-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcbad250-b44d-4723-81e7-2c44a23832d8" containerName="payload-processing"
Jul 29 07:05:49.295556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.295537    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a59660c-fdcd-4595-b5b3-3539361d58f6" containerName="revoke-keys"
Jul 29 07:05:49.298891 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.298871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.301297 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.301275    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4b144e\""
Jul 29 07:05:49.301406 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.301309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4b144e-dockercfg-tc6zf\""
Jul 29 07:05:49.308494 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.308472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"]
Jul 29 07:05:49.327504 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.327477    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"]
Jul 29 07:05:49.330912 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.330895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.340072 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.340052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"]
Jul 29 07:05:49.446409 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.446377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8k4n\" (UniqueName: \"kubernetes.io/projected/64d172d8-1b94-450f-924b-4cc6bd59b8f6-kube-api-access-d8k4n\") pod \"payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.446409 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.446414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fchq2\" (UniqueName: \"kubernetes.io/projected/0288d84b-fc23-4556-be79-fac8cc350b3a-kube-api-access-fchq2\") pod \"payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") " pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.446644 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.446444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64d172d8-1b94-450f-924b-4cc6bd59b8f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.446644 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.446520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0288d84b-fc23-4556-be79-fac8cc350b3a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") " pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.547783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.547662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8k4n\" (UniqueName: \"kubernetes.io/projected/64d172d8-1b94-450f-924b-4cc6bd59b8f6-kube-api-access-d8k4n\") pod \"payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.547783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.547700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fchq2\" (UniqueName: \"kubernetes.io/projected/0288d84b-fc23-4556-be79-fac8cc350b3a-kube-api-access-fchq2\") pod \"payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") " pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.547783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.547759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64d172d8-1b94-450f-924b-4cc6bd59b8f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.548052 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.547791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0288d84b-fc23-4556-be79-fac8cc350b3a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") " pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.548481 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.548462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0288d84b-fc23-4556-be79-fac8cc350b3a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") " pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.548517 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.548477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64d172d8-1b94-450f-924b-4cc6bd59b8f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.555837 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.555808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fchq2\" (UniqueName: \"kubernetes.io/projected/0288d84b-fc23-4556-be79-fac8cc350b3a-kube-api-access-fchq2\") pod \"payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") " pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.556058 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.556036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8k4n\" (UniqueName: \"kubernetes.io/projected/64d172d8-1b94-450f-924b-4cc6bd59b8f6-kube-api-access-d8k4n\") pod \"payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.610868 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.610830    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:49.641068 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.641034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:49.764693 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.764669    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"]
Jul 29 07:05:49.767247 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:05:49.767217    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d172d8_1b94_450f_924b_4cc6bd59b8f6.slice/crio-b23d0293c3634b90cccd7684a909f04a463cbb410a184ac30f2f34164ad6a278 WatchSource:0}: Error finding container b23d0293c3634b90cccd7684a909f04a463cbb410a184ac30f2f34164ad6a278: Status 404 returned error can't find the container with id b23d0293c3634b90cccd7684a909f04a463cbb410a184ac30f2f34164ad6a278
Jul 29 07:05:49.792299 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:49.792272    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"]
Jul 29 07:05:49.798895 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:05:49.798867    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0288d84b_fc23_4556_be79_fac8cc350b3a.slice/crio-c04e8e52b02f7347cff14072d903a74cfa5c49bf4f0f859bb185918a92a2bad3 WatchSource:0}: Error finding container c04e8e52b02f7347cff14072d903a74cfa5c49bf4f0f859bb185918a92a2bad3: Status 404 returned error can't find the container with id c04e8e52b02f7347cff14072d903a74cfa5c49bf4f0f859bb185918a92a2bad3
Jul 29 07:05:50.308120 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.308080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf" event={"ID":"0288d84b-fc23-4556-be79-fac8cc350b3a","Type":"ContainerStarted","Data":"b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b"}
Jul 29 07:05:50.308550 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.308144    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:05:50.308550 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.308163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf" event={"ID":"0288d84b-fc23-4556-be79-fac8cc350b3a","Type":"ContainerStarted","Data":"c04e8e52b02f7347cff14072d903a74cfa5c49bf4f0f859bb185918a92a2bad3"}
Jul 29 07:05:50.309776 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.309746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz" event={"ID":"64d172d8-1b94-450f-924b-4cc6bd59b8f6","Type":"ContainerStarted","Data":"d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7"}
Jul 29 07:05:50.309907 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.309796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz" event={"ID":"64d172d8-1b94-450f-924b-4cc6bd59b8f6","Type":"ContainerStarted","Data":"b23d0293c3634b90cccd7684a909f04a463cbb410a184ac30f2f34164ad6a278"}
Jul 29 07:05:50.309907 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.309834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:05:50.323039 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.322992    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf" podStartSLOduration=1.322973913 podStartE2EDuration="1.322973913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:05:50.322548778 +0000 UTC m=+2591.958140591" watchObservedRunningTime="2026-07-29 07:05:50.322973913 +0000 UTC m=+2591.958565701"
Jul 29 07:05:50.336385 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:50.336342    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz" podStartSLOduration=1.336322763 podStartE2EDuration="1.336322763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:05:50.335750492 +0000 UTC m=+2591.971342284" watchObservedRunningTime="2026-07-29 07:05:50.336322763 +0000 UTC m=+2591.971914558"
Jul 29 07:05:54.504512 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:05:54.504471    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:06:01.317501 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:01.317406    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:06:01.317501 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:01.317496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:06:17.422828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.422791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"]
Jul 29 07:06:17.426509 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.426492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.428945 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.428919    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-e87d49-dockercfg-rwhj6\""
Jul 29 07:06:17.428945 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.428921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-e87d49\""
Jul 29 07:06:17.433369 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.433347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"]
Jul 29 07:06:17.466220 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.466189    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"]
Jul 29 07:06:17.469578 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.469562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.474351 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.473829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc6a453e-9c11-4960-9d80-02adeaef071f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.474351 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.473870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvg9\" (UniqueName: \"kubernetes.io/projected/dc6a453e-9c11-4960-9d80-02adeaef071f-kube-api-access-bmvg9\") pod \"payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.474351 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.474019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2vt\" (UniqueName: \"kubernetes.io/projected/ac2d9e98-f456-453c-8ccd-71062e4aa41c-kube-api-access-vl2vt\") pod \"payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") " pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.474351 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.474057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac2d9e98-f456-453c-8ccd-71062e4aa41c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") " pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.477878 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.477854    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"]
Jul 29 07:06:17.575026 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.574981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc6a453e-9c11-4960-9d80-02adeaef071f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.575026 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.575027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvg9\" (UniqueName: \"kubernetes.io/projected/dc6a453e-9c11-4960-9d80-02adeaef071f-kube-api-access-bmvg9\") pod \"payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.575249 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.575090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2vt\" (UniqueName: \"kubernetes.io/projected/ac2d9e98-f456-453c-8ccd-71062e4aa41c-kube-api-access-vl2vt\") pod \"payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") " pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.575249 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.575110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac2d9e98-f456-453c-8ccd-71062e4aa41c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") " pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.575837 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.575817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc6a453e-9c11-4960-9d80-02adeaef071f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.575888 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.575836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac2d9e98-f456-453c-8ccd-71062e4aa41c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") " pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.597971 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.597938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2vt\" (UniqueName: \"kubernetes.io/projected/ac2d9e98-f456-453c-8ccd-71062e4aa41c-kube-api-access-vl2vt\") pod \"payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") " pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.598133 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.597998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvg9\" (UniqueName: \"kubernetes.io/projected/dc6a453e-9c11-4960-9d80-02adeaef071f-kube-api-access-bmvg9\") pod \"payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.738917 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.738831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:17.780407 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.780374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:17.903610 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:06:17.903566    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6a453e_9c11_4960_9d80_02adeaef071f.slice/crio-b81d0037900c02a52243dbbc145dcac99f0b8c7b024ad14709d8b0677793eca8 WatchSource:0}: Error finding container b81d0037900c02a52243dbbc145dcac99f0b8c7b024ad14709d8b0677793eca8: Status 404 returned error can't find the container with id b81d0037900c02a52243dbbc145dcac99f0b8c7b024ad14709d8b0677793eca8
Jul 29 07:06:17.903972 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.903944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"]
Jul 29 07:06:17.952966 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:17.952358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"]
Jul 29 07:06:17.954338 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:06:17.954312    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2d9e98_f456_453c_8ccd_71062e4aa41c.slice/crio-9efd99b0c962c20588b665633f1605d8aad4a8bbd936ed43ae75db00759c3c12 WatchSource:0}: Error finding container 9efd99b0c962c20588b665633f1605d8aad4a8bbd936ed43ae75db00759c3c12: Status 404 returned error can't find the container with id 9efd99b0c962c20588b665633f1605d8aad4a8bbd936ed43ae75db00759c3c12
Jul 29 07:06:18.472064 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.472026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w" event={"ID":"ac2d9e98-f456-453c-8ccd-71062e4aa41c","Type":"ContainerStarted","Data":"3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f"}
Jul 29 07:06:18.472539 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.472084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w" event={"ID":"ac2d9e98-f456-453c-8ccd-71062e4aa41c","Type":"ContainerStarted","Data":"9efd99b0c962c20588b665633f1605d8aad4a8bbd936ed43ae75db00759c3c12"}
Jul 29 07:06:18.472539 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.472186    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:18.473756 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.473734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv" event={"ID":"dc6a453e-9c11-4960-9d80-02adeaef071f","Type":"ContainerStarted","Data":"3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0"}
Jul 29 07:06:18.473886 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.473777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv" event={"ID":"dc6a453e-9c11-4960-9d80-02adeaef071f","Type":"ContainerStarted","Data":"b81d0037900c02a52243dbbc145dcac99f0b8c7b024ad14709d8b0677793eca8"}
Jul 29 07:06:18.473886 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.473809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:18.489178 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.489129    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w" podStartSLOduration=1.489113086 podStartE2EDuration="1.489113086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:06:18.486467489 +0000 UTC m=+2620.122059281" watchObservedRunningTime="2026-07-29 07:06:18.489113086 +0000 UTC m=+2620.124704876"
Jul 29 07:06:18.501236 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:18.501191    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv" podStartSLOduration=1.5011736180000002 podStartE2EDuration="1.501173618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:06:18.50033334 +0000 UTC m=+2620.135925131" watchObservedRunningTime="2026-07-29 07:06:18.501173618 +0000 UTC m=+2620.136765472"
Jul 29 07:06:24.805564 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:24.805525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:06:29.480913 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:29.480879    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:06:29.481394 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:29.480953    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:06:39.237421 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:39.237382    2578 scope.go:117] "RemoveContainer" containerID="6e8d25c63b4a8c7385c3a9b3712e6ec5cfae500925181f4c3b5ac5bb4af635c8"
Jul 29 07:06:44.507335 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.507300    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"]
Jul 29 07:06:44.512630 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.512609    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:44.515245 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.515220    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:06:44.515411 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.515225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:06:44.516843 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.516823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"]
Jul 29 07:06:44.613079 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.613039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85216bed-df29-44e0-83be-73b8e862b7cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp\" (UID: \"85216bed-df29-44e0-83be-73b8e862b7cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:44.714472 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.714430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85216bed-df29-44e0-83be-73b8e862b7cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp\" (UID: \"85216bed-df29-44e0-83be-73b8e862b7cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:44.715100 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.715081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85216bed-df29-44e0-83be-73b8e862b7cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp\" (UID: \"85216bed-df29-44e0-83be-73b8e862b7cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:44.824903 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.824816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:44.972616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:44.972592    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"]
Jul 29 07:06:44.974440 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:06:44.974416    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85216bed_df29_44e0_83be_73b8e862b7cf.slice/crio-bfb403676ebbf34570483364de8257d3e7f7f2e03187b627b6f9af9cf803b2c2 WatchSource:0}: Error finding container bfb403676ebbf34570483364de8257d3e7f7f2e03187b627b6f9af9cf803b2c2: Status 404 returned error can't find the container with id bfb403676ebbf34570483364de8257d3e7f7f2e03187b627b6f9af9cf803b2c2
Jul 29 07:06:45.640063 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:45.640022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp" event={"ID":"85216bed-df29-44e0-83be-73b8e862b7cf","Type":"ContainerStarted","Data":"a967d69d6544976f5ec4912c2efff9ab888885c40b4cf29a447cfec8a6bde0c0"}
Jul 29 07:06:45.640454 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:45.640087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp" event={"ID":"85216bed-df29-44e0-83be-73b8e862b7cf","Type":"ContainerStarted","Data":"bfb403676ebbf34570483364de8257d3e7f7f2e03187b627b6f9af9cf803b2c2"}
Jul 29 07:06:45.654575 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:45.654524    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp" podStartSLOduration=1.6545072379999999 podStartE2EDuration="1.654507238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:06:45.65313048 +0000 UTC m=+2647.288722272" watchObservedRunningTime="2026-07-29 07:06:45.654507238 +0000 UTC m=+2647.290099034"
Jul 29 07:06:46.647898 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:46.647862    2578 generic.go:356] "Generic (PLEG): container finished" podID="85216bed-df29-44e0-83be-73b8e862b7cf" containerID="a967d69d6544976f5ec4912c2efff9ab888885c40b4cf29a447cfec8a6bde0c0" exitCode=0
Jul 29 07:06:46.648289 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:46.647952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp" event={"ID":"85216bed-df29-44e0-83be-73b8e862b7cf","Type":"ContainerDied","Data":"a967d69d6544976f5ec4912c2efff9ab888885c40b4cf29a447cfec8a6bde0c0"}
Jul 29 07:06:47.814785 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:47.814762    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:47.946268 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:47.946171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85216bed-df29-44e0-83be-73b8e862b7cf-maas-api-service-ca\") pod \"85216bed-df29-44e0-83be-73b8e862b7cf\" (UID: \"85216bed-df29-44e0-83be-73b8e862b7cf\") "
Jul 29 07:06:47.946527 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:47.946504    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85216bed-df29-44e0-83be-73b8e862b7cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85216bed-df29-44e0-83be-73b8e862b7cf" (UID: "85216bed-df29-44e0-83be-73b8e862b7cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:06:48.047423 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:48.047384    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85216bed-df29-44e0-83be-73b8e862b7cf-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:06:48.669373 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:48.669339    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"
Jul 29 07:06:48.669373 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:48.669380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp" event={"ID":"85216bed-df29-44e0-83be-73b8e862b7cf","Type":"ContainerDied","Data":"bfb403676ebbf34570483364de8257d3e7f7f2e03187b627b6f9af9cf803b2c2"}
Jul 29 07:06:48.669633 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:48.669427    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfb403676ebbf34570483364de8257d3e7f7f2e03187b627b6f9af9cf803b2c2"
Jul 29 07:06:59.964689 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:59.964657    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"]
Jul 29 07:06:59.965169 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:59.964930    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf" podUID="0288d84b-fc23-4556-be79-fac8cc350b3a" containerName="payload-processing" containerID="cri-o://b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b" gracePeriod=30
Jul 29 07:06:59.980731 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:59.980682    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"]
Jul 29 07:06:59.986067 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:06:59.986012    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz" podUID="64d172d8-1b94-450f-924b-4cc6bd59b8f6" containerName="payload-pre-processing" containerID="cri-o://d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7" gracePeriod=30
Jul 29 07:07:00.110072 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.110034    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"]
Jul 29 07:07:00.112522 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.112491    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b144e-cm7tp"]
Jul 29 07:07:00.279247 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.279224    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:07:00.301288 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.301264    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:07:00.370958 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.370918    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fchq2\" (UniqueName: \"kubernetes.io/projected/0288d84b-fc23-4556-be79-fac8cc350b3a-kube-api-access-fchq2\") pod \"0288d84b-fc23-4556-be79-fac8cc350b3a\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") "
Jul 29 07:07:00.371152 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.371014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0288d84b-fc23-4556-be79-fac8cc350b3a-plugins-config-volume\") pod \"0288d84b-fc23-4556-be79-fac8cc350b3a\" (UID: \"0288d84b-fc23-4556-be79-fac8cc350b3a\") "
Jul 29 07:07:00.371413 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.371383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0288d84b-fc23-4556-be79-fac8cc350b3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0288d84b-fc23-4556-be79-fac8cc350b3a" (UID: "0288d84b-fc23-4556-be79-fac8cc350b3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:07:00.373292 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.373270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0288d84b-fc23-4556-be79-fac8cc350b3a-kube-api-access-fchq2" (OuterVolumeSpecName: "kube-api-access-fchq2") pod "0288d84b-fc23-4556-be79-fac8cc350b3a" (UID: "0288d84b-fc23-4556-be79-fac8cc350b3a"). InnerVolumeSpecName "kube-api-access-fchq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:07:00.472497 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.472460    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64d172d8-1b94-450f-924b-4cc6bd59b8f6-plugins-config-volume\") pod \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") "
Jul 29 07:07:00.472682 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.472546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8k4n\" (UniqueName: \"kubernetes.io/projected/64d172d8-1b94-450f-924b-4cc6bd59b8f6-kube-api-access-d8k4n\") pod \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\" (UID: \"64d172d8-1b94-450f-924b-4cc6bd59b8f6\") "
Jul 29 07:07:00.472802 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.472787    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0288d84b-fc23-4556-be79-fac8cc350b3a-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:00.472864 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.472811    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fchq2\" (UniqueName: \"kubernetes.io/projected/0288d84b-fc23-4556-be79-fac8cc350b3a-kube-api-access-fchq2\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:00.472921 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.472894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64d172d8-1b94-450f-924b-4cc6bd59b8f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64d172d8-1b94-450f-924b-4cc6bd59b8f6" (UID: "64d172d8-1b94-450f-924b-4cc6bd59b8f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:07:00.474758 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.474733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d172d8-1b94-450f-924b-4cc6bd59b8f6-kube-api-access-d8k4n" (OuterVolumeSpecName: "kube-api-access-d8k4n") pod "64d172d8-1b94-450f-924b-4cc6bd59b8f6" (UID: "64d172d8-1b94-450f-924b-4cc6bd59b8f6"). InnerVolumeSpecName "kube-api-access-d8k4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:07:00.573974 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.573899    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8k4n\" (UniqueName: \"kubernetes.io/projected/64d172d8-1b94-450f-924b-4cc6bd59b8f6-kube-api-access-d8k4n\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:00.573974 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.573928    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64d172d8-1b94-450f-924b-4cc6bd59b8f6-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:00.738610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.738576    2578 generic.go:356] "Generic (PLEG): container finished" podID="0288d84b-fc23-4556-be79-fac8cc350b3a" containerID="b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b" exitCode=0
Jul 29 07:07:00.738830 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.738624    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"
Jul 29 07:07:00.738830 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.738669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf" event={"ID":"0288d84b-fc23-4556-be79-fac8cc350b3a","Type":"ContainerDied","Data":"b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b"}
Jul 29 07:07:00.738830 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.738745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf" event={"ID":"0288d84b-fc23-4556-be79-fac8cc350b3a","Type":"ContainerDied","Data":"c04e8e52b02f7347cff14072d903a74cfa5c49bf4f0f859bb185918a92a2bad3"}
Jul 29 07:07:00.738830 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.738777    2578 scope.go:117] "RemoveContainer" containerID="b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b"
Jul 29 07:07:00.740023 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.739931    2578 generic.go:356] "Generic (PLEG): container finished" podID="64d172d8-1b94-450f-924b-4cc6bd59b8f6" containerID="d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7" exitCode=0
Jul 29 07:07:00.740023 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.739984    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"
Jul 29 07:07:00.740023 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.739991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz" event={"ID":"64d172d8-1b94-450f-924b-4cc6bd59b8f6","Type":"ContainerDied","Data":"d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7"}
Jul 29 07:07:00.740157 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.740060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz" event={"ID":"64d172d8-1b94-450f-924b-4cc6bd59b8f6","Type":"ContainerDied","Data":"b23d0293c3634b90cccd7684a909f04a463cbb410a184ac30f2f34164ad6a278"}
Jul 29 07:07:00.750520 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.750497    2578 scope.go:117] "RemoveContainer" containerID="b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b"
Jul 29 07:07:00.750916 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:07:00.750873    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b\": container with ID starting with b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b not found: ID does not exist" containerID="b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b"
Jul 29 07:07:00.750992 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.750913    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b"} err="failed to get container status \"b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b\": rpc error: code = NotFound desc = could not find container \"b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b\": container with ID starting with b90714c71f707408b254dd775bbbc3709c23c78a89a58f855b3fcd028b67531b not found: ID does not exist"
Jul 29 07:07:00.750992 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.750939    2578 scope.go:117] "RemoveContainer" containerID="d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7"
Jul 29 07:07:00.761631 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.761611    2578 scope.go:117] "RemoveContainer" containerID="d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7"
Jul 29 07:07:00.762111 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:07:00.762046    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7\": container with ID starting with d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7 not found: ID does not exist" containerID="d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7"
Jul 29 07:07:00.762234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.762113    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7"} err="failed to get container status \"d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7\": rpc error: code = NotFound desc = could not find container \"d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7\": container with ID starting with d6e4ae994ee525b9383626fa2e84e7a635b9aa9e9f4e531630b709d6f84206c7 not found: ID does not exist"
Jul 29 07:07:00.764927 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.764907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"]
Jul 29 07:07:00.768497 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.768477    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz"]
Jul 29 07:07:00.778422 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.778398    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"]
Jul 29 07:07:00.783888 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.783866    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf"]
Jul 29 07:07:00.904742 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.904684    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0288d84b-fc23-4556-be79-fac8cc350b3a" path="/var/lib/kubelet/pods/0288d84b-fc23-4556-be79-fac8cc350b3a/volumes"
Jul 29 07:07:00.905083 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.905070    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64d172d8-1b94-450f-924b-4cc6bd59b8f6" path="/var/lib/kubelet/pods/64d172d8-1b94-450f-924b-4cc6bd59b8f6/volumes"
Jul 29 07:07:00.905346 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:00.905334    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85216bed-df29-44e0-83be-73b8e862b7cf" path="/var/lib/kubelet/pods/85216bed-df29-44e0-83be-73b8e862b7cf/volumes"
Jul 29 07:07:02.507939 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:02.507904    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:07:06.808994 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.808954    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"]
Jul 29 07:07:06.809530 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809511    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85216bed-df29-44e0-83be-73b8e862b7cf" containerName="revoke-keys"
Jul 29 07:07:06.809616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809532    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85216bed-df29-44e0-83be-73b8e862b7cf" containerName="revoke-keys"
Jul 29 07:07:06.809616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809562    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d172d8-1b94-450f-924b-4cc6bd59b8f6" containerName="payload-pre-processing"
Jul 29 07:07:06.809616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809573    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d172d8-1b94-450f-924b-4cc6bd59b8f6" containerName="payload-pre-processing"
Jul 29 07:07:06.809616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809591    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0288d84b-fc23-4556-be79-fac8cc350b3a" containerName="payload-processing"
Jul 29 07:07:06.809616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809600    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0288d84b-fc23-4556-be79-fac8cc350b3a" containerName="payload-processing"
Jul 29 07:07:06.809885 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809731    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0288d84b-fc23-4556-be79-fac8cc350b3a" containerName="payload-processing"
Jul 29 07:07:06.809885 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809746    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64d172d8-1b94-450f-924b-4cc6bd59b8f6" containerName="payload-pre-processing"
Jul 29 07:07:06.809885 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.809755    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85216bed-df29-44e0-83be-73b8e862b7cf" containerName="revoke-keys"
Jul 29 07:07:06.814436 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.814415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:06.817219 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.817196    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:07:06.817476 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.817359    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:07:06.821799 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.821776    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"]
Jul 29 07:07:06.931775 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:06.931703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f12e43-5531-4bac-a3f7-18b49daf8748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e87d49-4c26d\" (UID: \"c3f12e43-5531-4bac-a3f7-18b49daf8748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:07.032471 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.032435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f12e43-5531-4bac-a3f7-18b49daf8748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e87d49-4c26d\" (UID: \"c3f12e43-5531-4bac-a3f7-18b49daf8748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:07.033115 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.033082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f12e43-5531-4bac-a3f7-18b49daf8748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e87d49-4c26d\" (UID: \"c3f12e43-5531-4bac-a3f7-18b49daf8748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:07.126549 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.126514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:07.265913 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.265884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"]
Jul 29 07:07:07.267263 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:07:07.267240    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f12e43_5531_4bac_a3f7_18b49daf8748.slice/crio-e3a813e1588cad2a89cafb6c712c48052fa827c1534725c7fef6c9c6dc8fc0a5 WatchSource:0}: Error finding container e3a813e1588cad2a89cafb6c712c48052fa827c1534725c7fef6c9c6dc8fc0a5: Status 404 returned error can't find the container with id e3a813e1588cad2a89cafb6c712c48052fa827c1534725c7fef6c9c6dc8fc0a5
Jul 29 07:07:07.786196 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.786096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d" event={"ID":"c3f12e43-5531-4bac-a3f7-18b49daf8748","Type":"ContainerStarted","Data":"5a4bd0e7d800e596c009e015f577f184990656fdce0c89301b0669c97e9204f2"}
Jul 29 07:07:07.786196 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.786144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d" event={"ID":"c3f12e43-5531-4bac-a3f7-18b49daf8748","Type":"ContainerStarted","Data":"e3a813e1588cad2a89cafb6c712c48052fa827c1534725c7fef6c9c6dc8fc0a5"}
Jul 29 07:07:07.804033 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:07.803982    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d" podStartSLOduration=1.8039660290000001 podStartE2EDuration="1.803966029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:07:07.802843987 +0000 UTC m=+2669.438435790" watchObservedRunningTime="2026-07-29 07:07:07.803966029 +0000 UTC m=+2669.439557814"
Jul 29 07:07:08.793011 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:08.792971    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3f12e43-5531-4bac-a3f7-18b49daf8748" containerID="5a4bd0e7d800e596c009e015f577f184990656fdce0c89301b0669c97e9204f2" exitCode=0
Jul 29 07:07:08.793400 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:08.793066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d" event={"ID":"c3f12e43-5531-4bac-a3f7-18b49daf8748","Type":"ContainerDied","Data":"5a4bd0e7d800e596c009e015f577f184990656fdce0c89301b0669c97e9204f2"}
Jul 29 07:07:09.944586 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:09.944558    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:09.953844 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:09.953819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f12e43-5531-4bac-a3f7-18b49daf8748-maas-api-service-ca\") pod \"c3f12e43-5531-4bac-a3f7-18b49daf8748\" (UID: \"c3f12e43-5531-4bac-a3f7-18b49daf8748\") "
Jul 29 07:07:09.954211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:09.954186    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f12e43-5531-4bac-a3f7-18b49daf8748-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3f12e43-5531-4bac-a3f7-18b49daf8748" (UID: "c3f12e43-5531-4bac-a3f7-18b49daf8748"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:07:10.054765 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:10.054634    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f12e43-5531-4bac-a3f7-18b49daf8748-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:10.806228 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:10.806189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d" event={"ID":"c3f12e43-5531-4bac-a3f7-18b49daf8748","Type":"ContainerDied","Data":"e3a813e1588cad2a89cafb6c712c48052fa827c1534725c7fef6c9c6dc8fc0a5"}
Jul 29 07:07:10.806228 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:10.806211    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"
Jul 29 07:07:10.806450 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:10.806244    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3a813e1588cad2a89cafb6c712c48052fa827c1534725c7fef6c9c6dc8fc0a5"
Jul 29 07:07:22.261875 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.261839    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"]
Jul 29 07:07:22.262656 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.262616    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w" podUID="ac2d9e98-f456-453c-8ccd-71062e4aa41c" containerName="payload-processing" containerID="cri-o://3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f" gracePeriod=30
Jul 29 07:07:22.266769 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.266742    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"]
Jul 29 07:07:22.267031 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.266965    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv" podUID="dc6a453e-9c11-4960-9d80-02adeaef071f" containerName="payload-pre-processing" containerID="cri-o://3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0" gracePeriod=30
Jul 29 07:07:22.389879 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.389841    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"]
Jul 29 07:07:22.392135 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.392111    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e87d49-4c26d"]
Jul 29 07:07:22.530680 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.530654    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:07:22.558418 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.557953    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc6a453e-9c11-4960-9d80-02adeaef071f-plugins-config-volume\") pod \"dc6a453e-9c11-4960-9d80-02adeaef071f\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") "
Jul 29 07:07:22.558418 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.558074    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmvg9\" (UniqueName: \"kubernetes.io/projected/dc6a453e-9c11-4960-9d80-02adeaef071f-kube-api-access-bmvg9\") pod \"dc6a453e-9c11-4960-9d80-02adeaef071f\" (UID: \"dc6a453e-9c11-4960-9d80-02adeaef071f\") "
Jul 29 07:07:22.559097 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.559068    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc6a453e-9c11-4960-9d80-02adeaef071f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc6a453e-9c11-4960-9d80-02adeaef071f" (UID: "dc6a453e-9c11-4960-9d80-02adeaef071f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:07:22.562037 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.562010    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc6a453e-9c11-4960-9d80-02adeaef071f-kube-api-access-bmvg9" (OuterVolumeSpecName: "kube-api-access-bmvg9") pod "dc6a453e-9c11-4960-9d80-02adeaef071f" (UID: "dc6a453e-9c11-4960-9d80-02adeaef071f"). InnerVolumeSpecName "kube-api-access-bmvg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:07:22.569118 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.569098    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:07:22.659623 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.659580    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl2vt\" (UniqueName: \"kubernetes.io/projected/ac2d9e98-f456-453c-8ccd-71062e4aa41c-kube-api-access-vl2vt\") pod \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") "
Jul 29 07:07:22.659860 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.659642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac2d9e98-f456-453c-8ccd-71062e4aa41c-plugins-config-volume\") pod \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\" (UID: \"ac2d9e98-f456-453c-8ccd-71062e4aa41c\") "
Jul 29 07:07:22.659860 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.659836    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc6a453e-9c11-4960-9d80-02adeaef071f-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:22.659987 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.659868    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmvg9\" (UniqueName: \"kubernetes.io/projected/dc6a453e-9c11-4960-9d80-02adeaef071f-kube-api-access-bmvg9\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:22.660041 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.660001    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac2d9e98-f456-453c-8ccd-71062e4aa41c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac2d9e98-f456-453c-8ccd-71062e4aa41c" (UID: "ac2d9e98-f456-453c-8ccd-71062e4aa41c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:07:22.661867 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.661843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2d9e98-f456-453c-8ccd-71062e4aa41c-kube-api-access-vl2vt" (OuterVolumeSpecName: "kube-api-access-vl2vt") pod "ac2d9e98-f456-453c-8ccd-71062e4aa41c" (UID: "ac2d9e98-f456-453c-8ccd-71062e4aa41c"). InnerVolumeSpecName "kube-api-access-vl2vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:07:22.761128 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.761094    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl2vt\" (UniqueName: \"kubernetes.io/projected/ac2d9e98-f456-453c-8ccd-71062e4aa41c-kube-api-access-vl2vt\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:22.761128 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.761120    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac2d9e98-f456-453c-8ccd-71062e4aa41c-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:07:22.878493 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.878457    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac2d9e98-f456-453c-8ccd-71062e4aa41c" containerID="3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f" exitCode=0
Jul 29 07:07:22.878674 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.878513    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"
Jul 29 07:07:22.878674 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.878552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w" event={"ID":"ac2d9e98-f456-453c-8ccd-71062e4aa41c","Type":"ContainerDied","Data":"3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f"}
Jul 29 07:07:22.878674 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.878635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w" event={"ID":"ac2d9e98-f456-453c-8ccd-71062e4aa41c","Type":"ContainerDied","Data":"9efd99b0c962c20588b665633f1605d8aad4a8bbd936ed43ae75db00759c3c12"}
Jul 29 07:07:22.878674 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.878668    2578 scope.go:117] "RemoveContainer" containerID="3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f"
Jul 29 07:07:22.879981 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.879960    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc6a453e-9c11-4960-9d80-02adeaef071f" containerID="3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0" exitCode=0
Jul 29 07:07:22.880088 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.880023    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"
Jul 29 07:07:22.880088 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.880038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv" event={"ID":"dc6a453e-9c11-4960-9d80-02adeaef071f","Type":"ContainerDied","Data":"3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0"}
Jul 29 07:07:22.880165 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.880101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv" event={"ID":"dc6a453e-9c11-4960-9d80-02adeaef071f","Type":"ContainerDied","Data":"b81d0037900c02a52243dbbc145dcac99f0b8c7b024ad14709d8b0677793eca8"}
Jul 29 07:07:22.888329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.888309    2578 scope.go:117] "RemoveContainer" containerID="3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f"
Jul 29 07:07:22.888648 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:07:22.888627    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f\": container with ID starting with 3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f not found: ID does not exist" containerID="3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f"
Jul 29 07:07:22.888759 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.888653    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f"} err="failed to get container status \"3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f\": rpc error: code = NotFound desc = could not find container \"3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f\": container with ID starting with 3431449589fbd0906278c6f5b212dfcc6d02432de8235710c5ed7068b7e3547f not found: ID does not exist"
Jul 29 07:07:22.888759 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.888670    2578 scope.go:117] "RemoveContainer" containerID="3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0"
Jul 29 07:07:22.897509 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.897492    2578 scope.go:117] "RemoveContainer" containerID="3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0"
Jul 29 07:07:22.897793 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:07:22.897772    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0\": container with ID starting with 3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0 not found: ID does not exist" containerID="3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0"
Jul 29 07:07:22.897855 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.897800    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0"} err="failed to get container status \"3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0\": rpc error: code = NotFound desc = could not find container \"3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0\": container with ID starting with 3c8f87916c105bad2099a822b0d0c336c0c7784921822fb3e9440dd54522e4c0 not found: ID does not exist"
Jul 29 07:07:22.909478 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.909456    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f12e43-5531-4bac-a3f7-18b49daf8748" path="/var/lib/kubelet/pods/c3f12e43-5531-4bac-a3f7-18b49daf8748/volumes"
Jul 29 07:07:22.909741 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.909728    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"]
Jul 29 07:07:22.909783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.909753    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv"]
Jul 29 07:07:22.919073 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.919040    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"]
Jul 29 07:07:22.923008 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:22.922989    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w"]
Jul 29 07:07:24.904832 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:24.904801    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2d9e98-f456-453c-8ccd-71062e4aa41c" path="/var/lib/kubelet/pods/ac2d9e98-f456-453c-8ccd-71062e4aa41c/volumes"
Jul 29 07:07:24.905192 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:24.905123    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc6a453e-9c11-4960-9d80-02adeaef071f" path="/var/lib/kubelet/pods/dc6a453e-9c11-4960-9d80-02adeaef071f/volumes"
Jul 29 07:07:27.005197 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:27.005162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:07:33.848990 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.848906    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"]
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849313    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2d9e98-f456-453c-8ccd-71062e4aa41c" containerName="payload-processing"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849325    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2d9e98-f456-453c-8ccd-71062e4aa41c" containerName="payload-processing"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849337    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc6a453e-9c11-4960-9d80-02adeaef071f" containerName="payload-pre-processing"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849343    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc6a453e-9c11-4960-9d80-02adeaef071f" containerName="payload-pre-processing"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849356    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f12e43-5531-4bac-a3f7-18b49daf8748" containerName="revoke-keys"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849370    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f12e43-5531-4bac-a3f7-18b49daf8748" containerName="revoke-keys"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849442    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc6a453e-9c11-4960-9d80-02adeaef071f" containerName="payload-pre-processing"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849451    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2d9e98-f456-453c-8ccd-71062e4aa41c" containerName="payload-processing"
Jul 29 07:07:33.849459 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.849457    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f12e43-5531-4bac-a3f7-18b49daf8748" containerName="revoke-keys"
Jul 29 07:07:33.854237 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.854211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:33.856952 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.856926    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-50e693\""
Jul 29 07:07:33.856952 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.856947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-50e693-dockercfg-ljpkl\""
Jul 29 07:07:33.861267 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.861242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"]
Jul 29 07:07:33.958557 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.958526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n45zp\" (UniqueName: \"kubernetes.io/projected/de28827f-b50a-4fa8-95d7-922137f6869f-kube-api-access-n45zp\") pod \"payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:33.958784 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:33.958583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de28827f-b50a-4fa8-95d7-922137f6869f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.060089 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.060045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45zp\" (UniqueName: \"kubernetes.io/projected/de28827f-b50a-4fa8-95d7-922137f6869f-kube-api-access-n45zp\") pod \"payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.060089 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.060095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de28827f-b50a-4fa8-95d7-922137f6869f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.060780 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.060752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de28827f-b50a-4fa8-95d7-922137f6869f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.068078 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.068054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n45zp\" (UniqueName: \"kubernetes.io/projected/de28827f-b50a-4fa8-95d7-922137f6869f-kube-api-access-n45zp\") pod \"payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.167423 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.167381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.520202 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.520174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"]
Jul 29 07:07:34.522113 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:07:34.522079    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde28827f_b50a_4fa8_95d7_922137f6869f.slice/crio-6d1e718d2a86a43c9bdc07bf8280310562eca1d2aaceb3217f3f83353f76b35b WatchSource:0}: Error finding container 6d1e718d2a86a43c9bdc07bf8280310562eca1d2aaceb3217f3f83353f76b35b: Status 404 returned error can't find the container with id 6d1e718d2a86a43c9bdc07bf8280310562eca1d2aaceb3217f3f83353f76b35b
Jul 29 07:07:34.956882 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.956843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh" event={"ID":"de28827f-b50a-4fa8-95d7-922137f6869f","Type":"ContainerStarted","Data":"c4b34f0feae6adca1642b939ac5fadd9bd30f39b7e5f6a2c05e8c8fbe90bf5b2"}
Jul 29 07:07:34.957384 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.956915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:07:34.957384 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.956940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh" event={"ID":"de28827f-b50a-4fa8-95d7-922137f6869f","Type":"ContainerStarted","Data":"6d1e718d2a86a43c9bdc07bf8280310562eca1d2aaceb3217f3f83353f76b35b"}
Jul 29 07:07:34.973668 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:34.973609    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh" podStartSLOduration=1.973589311 podStartE2EDuration="1.973589311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:07:34.973038964 +0000 UTC m=+2696.608630757" watchObservedRunningTime="2026-07-29 07:07:34.973589311 +0000 UTC m=+2696.609181104"
Jul 29 07:07:38.413266 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:38.413231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:07:39.076692 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:39.076654    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:07:39.082489 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:39.082465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:07:39.107660 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:39.107634    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:07:39.111869 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:39.111848    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:07:45.965158 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:07:45.965120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:08:03.739808 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.739773    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"]
Jul 29 07:08:03.743329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.743309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:03.746619 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.746597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-1e6a9b-dockercfg-lx7tk\""
Jul 29 07:08:03.746818 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.746797    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1e6a9b\""
Jul 29 07:08:03.758505 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.758481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"]
Jul 29 07:08:03.828614 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.828583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20679830-0c4c-4c27-b963-c750b7583726-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:03.828614 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.828616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bd8r\" (UniqueName: \"kubernetes.io/projected/20679830-0c4c-4c27-b963-c750b7583726-kube-api-access-7bd8r\") pod \"payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:03.856482 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.856447    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"]
Jul 29 07:08:03.860141 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.860117    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:03.878861 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.878837    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"]
Jul 29 07:08:03.929473 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.929437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20679830-0c4c-4c27-b963-c750b7583726-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:03.929473 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.929472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bd8r\" (UniqueName: \"kubernetes.io/projected/20679830-0c4c-4c27-b963-c750b7583726-kube-api-access-7bd8r\") pod \"payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:03.929683 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.929494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-kube-api-access-cjchq\") pod \"payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:03.929683 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.929535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:03.930121 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.930102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20679830-0c4c-4c27-b963-c750b7583726-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:03.942588 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:03.942560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bd8r\" (UniqueName: \"kubernetes.io/projected/20679830-0c4c-4c27-b963-c750b7583726-kube-api-access-7bd8r\") pod \"payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:04.030998 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.030915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-kube-api-access-cjchq\") pod \"payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:04.030998 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.030961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:04.031585 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.031566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:04.047669 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.047641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-kube-api-access-cjchq\") pod \"payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:04.054114 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.054083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:04.170110 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.170073    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:04.385848 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.385822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"]
Jul 29 07:08:04.386406 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:08:04.386386    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158c0a08_6b25_4dd7_a4ed_a9e55956b3fa.slice/crio-cba2afeae0ec8baeb1e144af84c2b14a1daddd508876ad1474297bd35c553971 WatchSource:0}: Error finding container cba2afeae0ec8baeb1e144af84c2b14a1daddd508876ad1474297bd35c553971: Status 404 returned error can't find the container with id cba2afeae0ec8baeb1e144af84c2b14a1daddd508876ad1474297bd35c553971
Jul 29 07:08:04.432226 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:04.432199    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"]
Jul 29 07:08:05.134541 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.134497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp" event={"ID":"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa","Type":"ContainerStarted","Data":"4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed"}
Jul 29 07:08:05.135232 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.135206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp" event={"ID":"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa","Type":"ContainerStarted","Data":"cba2afeae0ec8baeb1e144af84c2b14a1daddd508876ad1474297bd35c553971"}
Jul 29 07:08:05.136171 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.136151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:05.138488 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.138462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p" event={"ID":"20679830-0c4c-4c27-b963-c750b7583726","Type":"ContainerStarted","Data":"36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae"}
Jul 29 07:08:05.138593 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.138501    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p" event={"ID":"20679830-0c4c-4c27-b963-c750b7583726","Type":"ContainerStarted","Data":"4e7a2a43dba2db836a7f2f031690a69d19cb858e5f696a12e83a4a6e40edfd80"}
Jul 29 07:08:05.138636 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.138610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:05.163608 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.163545    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp" podStartSLOduration=2.163524753 podStartE2EDuration="2.163524753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:08:05.160571357 +0000 UTC m=+2726.796163148" watchObservedRunningTime="2026-07-29 07:08:05.163524753 +0000 UTC m=+2726.799116549"
Jul 29 07:08:05.202431 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:05.202381    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p" podStartSLOduration=2.202364221 podStartE2EDuration="2.202364221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:08:05.200656026 +0000 UTC m=+2726.836247816" watchObservedRunningTime="2026-07-29 07:08:05.202364221 +0000 UTC m=+2726.837956012"
Jul 29 07:08:10.609451 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:10.609412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:08:16.146882 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:16.146854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:08:17.152540 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:17.152507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:08:37.335034 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:08:37.335001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:09:01.992314 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:01.992235    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"]
Jul 29 07:09:01.995702 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:01.995686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.000742 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.000703    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e6a9b\"/\"kube-root-ca.crt\""
Jul 29 07:09:02.001937 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.001916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e6a9b\"/\"default-dockercfg-xw6xs\""
Jul 29 07:09:02.002033 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.001920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e6a9b\"/\"auth-test-model-1e6a9b-kserve-self-signed-certs\""
Jul 29 07:09:02.002479 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.002244    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e6a9b\"/\"openshift-service-ca.crt\""
Jul 29 07:09:02.033645 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.033613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjkz2\" (UniqueName: \"kubernetes.io/projected/d75de131-6012-496f-96ab-335523833313-kube-api-access-cjkz2\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.033883 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.033676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75de131-6012-496f-96ab-335523833313-tls-certs\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.033883 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.033819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-tmp-dir\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.033883 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.033848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-model-cache\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.034068 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.033964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-home\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.034068 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.033997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-dshm\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.036418 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.036393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"]
Jul 29 07:09:02.135310 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75de131-6012-496f-96ab-335523833313-tls-certs\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.135499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-tmp-dir\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.135499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-model-cache\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.135610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-home\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.135610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-dshm\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.135610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjkz2\" (UniqueName: \"kubernetes.io/projected/d75de131-6012-496f-96ab-335523833313-kube-api-access-cjkz2\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.135897 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-tmp-dir\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.136037 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.135930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-model-cache\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.136105 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.136042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-home\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.137927 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.137899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-dshm\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.138131 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.138110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75de131-6012-496f-96ab-335523833313-tls-certs\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.149275 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.149252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjkz2\" (UniqueName: \"kubernetes.io/projected/d75de131-6012-496f-96ab-335523833313-kube-api-access-cjkz2\") pod \"auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt\" (UID: \"d75de131-6012-496f-96ab-335523833313\") " pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.304804 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.304681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:02.460701 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:02.460662    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"]
Jul 29 07:09:02.465160 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:09:02.465122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd75de131_6012_496f_96ab_335523833313.slice/crio-b351171990ac37bdec68b802fb9156414549563b184f7108055bedf5d73bf04e WatchSource:0}: Error finding container b351171990ac37bdec68b802fb9156414549563b184f7108055bedf5d73bf04e: Status 404 returned error can't find the container with id b351171990ac37bdec68b802fb9156414549563b184f7108055bedf5d73bf04e
Jul 29 07:09:03.474889 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:03.474849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt" event={"ID":"d75de131-6012-496f-96ab-335523833313","Type":"ContainerStarted","Data":"c66cb6edf75b5fb3db64d3b6b038fb4e16864a196bd5f64a056ae14a43920b64"}
Jul 29 07:09:03.474889 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:03.474896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt" event={"ID":"d75de131-6012-496f-96ab-335523833313","Type":"ContainerStarted","Data":"b351171990ac37bdec68b802fb9156414549563b184f7108055bedf5d73bf04e"}
Jul 29 07:09:03.504891 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:03.504839    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt" podStartSLOduration=2.504822468 podStartE2EDuration="2.504822468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:09:03.504744754 +0000 UTC m=+2785.140336562" watchObservedRunningTime="2026-07-29 07:09:03.504822468 +0000 UTC m=+2785.140414259"
Jul 29 07:09:05.850891 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:05.850858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:09:12.305496 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:12.305457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:12.306008 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:12.305510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:12.317907 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:12.317884    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:12.537307 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:12.537269    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:09:33.856766 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:09:33.856728    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:10:00.217290 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:10:00.217252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:10:14.310249 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:10:14.310213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:10:28.713255 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:10:28.713216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:10:55.009688 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:10:55.009607    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:11:13.608621 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:11:13.608583    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:11:35.912107 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:11:35.912076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:11:39.319556 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:11:39.319523    2578 scope.go:117] "RemoveContainer" containerID="fd2a343dbe3d5001b67d433b3f15b392e0c09babdabc77957b42d9f006d9d3da"
Jul 29 07:11:53.505389 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:11:53.505348    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:12:19.707821 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:12:19.707790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:12:35.914820 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:12:35.914785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:12:39.122016 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:12:39.121989    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:12:39.126562 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:12:39.126537    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:12:39.145682 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:12:39.145661    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:12:39.149772 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:12:39.149756    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:13:02.506008 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:02.505967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:13:18.805642 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:18.805600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:13:38.908907 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:38.908825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:13:39.359200 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:39.359120    2578 scope.go:117] "RemoveContainer" containerID="5a4bd0e7d800e596c009e015f577f184990656fdce0c89301b0669c97e9204f2"
Jul 29 07:13:39.368456 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:39.368435    2578 scope.go:117] "RemoveContainer" containerID="a967d69d6544976f5ec4912c2efff9ab888885c40b4cf29a447cfec8a6bde0c0"
Jul 29 07:13:44.939896 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:44.939860    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"]
Jul 29 07:13:56.110122 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:56.110088    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:13:59.960230 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:13:59.960184    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt" podUID="d75de131-6012-496f-96ab-335523833313" containerName="main" containerID="cri-o://c66cb6edf75b5fb3db64d3b6b038fb4e16864a196bd5f64a056ae14a43920b64" gracePeriod=45
Jul 29 07:14:00.185791 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.185759    2578 generic.go:356] "Generic (PLEG): container finished" podID="d75de131-6012-496f-96ab-335523833313" containerID="c66cb6edf75b5fb3db64d3b6b038fb4e16864a196bd5f64a056ae14a43920b64" exitCode=0
Jul 29 07:14:00.185952 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.185840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt" event={"ID":"d75de131-6012-496f-96ab-335523833313","Type":"ContainerDied","Data":"c66cb6edf75b5fb3db64d3b6b038fb4e16864a196bd5f64a056ae14a43920b64"}
Jul 29 07:14:00.217013 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.216956    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:14:00.267724 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.267682    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75de131-6012-496f-96ab-335523833313-tls-certs\") pod \"d75de131-6012-496f-96ab-335523833313\" (UID: \"d75de131-6012-496f-96ab-335523833313\") "
Jul 29 07:14:00.267868 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.267749    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-tmp-dir\") pod \"d75de131-6012-496f-96ab-335523833313\" (UID: \"d75de131-6012-496f-96ab-335523833313\") "
Jul 29 07:14:00.267868 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.267800    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjkz2\" (UniqueName: \"kubernetes.io/projected/d75de131-6012-496f-96ab-335523833313-kube-api-access-cjkz2\") pod \"d75de131-6012-496f-96ab-335523833313\" (UID: \"d75de131-6012-496f-96ab-335523833313\") "
Jul 29 07:14:00.267868 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.267815    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-home\") pod \"d75de131-6012-496f-96ab-335523833313\" (UID: \"d75de131-6012-496f-96ab-335523833313\") "
Jul 29 07:14:00.267868 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.267862    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-model-cache\") pod \"d75de131-6012-496f-96ab-335523833313\" (UID: \"d75de131-6012-496f-96ab-335523833313\") "
Jul 29 07:14:00.268080 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.267892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-dshm\") pod \"d75de131-6012-496f-96ab-335523833313\" (UID: \"d75de131-6012-496f-96ab-335523833313\") "
Jul 29 07:14:00.268080 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.268017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d75de131-6012-496f-96ab-335523833313" (UID: "d75de131-6012-496f-96ab-335523833313"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:14:00.268180 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.268126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-home" (OuterVolumeSpecName: "home") pod "d75de131-6012-496f-96ab-335523833313" (UID: "d75de131-6012-496f-96ab-335523833313"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:14:00.268180 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.268164    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-model-cache" (OuterVolumeSpecName: "model-cache") pod "d75de131-6012-496f-96ab-335523833313" (UID: "d75de131-6012-496f-96ab-335523833313"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:14:00.268262 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.268218    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-tmp-dir\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:14:00.268262 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.268235    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-home\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:14:00.270102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.270072    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d75de131-6012-496f-96ab-335523833313-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d75de131-6012-496f-96ab-335523833313" (UID: "d75de131-6012-496f-96ab-335523833313"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 07:14:00.270212 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.270124    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-dshm" (OuterVolumeSpecName: "dshm") pod "d75de131-6012-496f-96ab-335523833313" (UID: "d75de131-6012-496f-96ab-335523833313"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:14:00.270212 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.270142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d75de131-6012-496f-96ab-335523833313-kube-api-access-cjkz2" (OuterVolumeSpecName: "kube-api-access-cjkz2") pod "d75de131-6012-496f-96ab-335523833313" (UID: "d75de131-6012-496f-96ab-335523833313"). InnerVolumeSpecName "kube-api-access-cjkz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:14:00.369354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.369323    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75de131-6012-496f-96ab-335523833313-tls-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:14:00.369354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.369347    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjkz2\" (UniqueName: \"kubernetes.io/projected/d75de131-6012-496f-96ab-335523833313-kube-api-access-cjkz2\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:14:00.369354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.369356    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-model-cache\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:14:00.369354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:00.369364    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75de131-6012-496f-96ab-335523833313-dshm\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:14:01.192759 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.192656    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"
Jul 29 07:14:01.192759 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.192690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt" event={"ID":"d75de131-6012-496f-96ab-335523833313","Type":"ContainerDied","Data":"b351171990ac37bdec68b802fb9156414549563b184f7108055bedf5d73bf04e"}
Jul 29 07:14:01.192759 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.192754    2578 scope.go:117] "RemoveContainer" containerID="c66cb6edf75b5fb3db64d3b6b038fb4e16864a196bd5f64a056ae14a43920b64"
Jul 29 07:14:01.211463 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.211434    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"]
Jul 29 07:14:01.215099 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.215074    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e6a9b/auth-test-model-1e6a9b-kserve-554c74cf9f-bcmzt"]
Jul 29 07:14:01.415572 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.415541    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"]
Jul 29 07:14:01.415946 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.415933    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75de131-6012-496f-96ab-335523833313" containerName="main"
Jul 29 07:14:01.415990 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.415948    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75de131-6012-496f-96ab-335523833313" containerName="main"
Jul 29 07:14:01.416032 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.416026    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d75de131-6012-496f-96ab-335523833313" containerName="main"
Jul 29 07:14:01.420335 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.420317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.423079 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.423052    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50e693\"/\"openshift-service-ca.crt\""
Jul 29 07:14:01.423242 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.423150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50e693\"/\"default-dockercfg-5z74d\""
Jul 29 07:14:01.423242 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.423163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50e693\"/\"sub-test-model-50e693-kserve-self-signed-certs\""
Jul 29 07:14:01.423362 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.423273    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50e693\"/\"kube-root-ca.crt\""
Jul 29 07:14:01.428462 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.428436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"]
Jul 29 07:14:01.477563 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.477463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j277\" (UniqueName: \"kubernetes.io/projected/7408dd12-2705-4542-aa59-8caf6ae08de8-kube-api-access-6j277\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.477563 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.477544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-home\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.477828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.477573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-dshm\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.477828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.477619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-tmp-dir\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.477828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.477638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-model-cache\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.477828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.477652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7408dd12-2705-4542-aa59-8caf6ae08de8-tls-certs\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579096 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-model-cache\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579096 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7408dd12-2705-4542-aa59-8caf6ae08de8-tls-certs\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579332 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j277\" (UniqueName: \"kubernetes.io/projected/7408dd12-2705-4542-aa59-8caf6ae08de8-kube-api-access-6j277\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579332 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-home\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579332 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-dshm\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579332 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-tmp-dir\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579527 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-model-cache\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579593 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-home\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.579593 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.579585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-tmp-dir\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.581771 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.581697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-dshm\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.581895 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.581880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7408dd12-2705-4542-aa59-8caf6ae08de8-tls-certs\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.587692 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.587665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j277\" (UniqueName: \"kubernetes.io/projected/7408dd12-2705-4542-aa59-8caf6ae08de8-kube-api-access-6j277\") pod \"sub-test-model-50e693-kserve-78cfc44b67-rcz8j\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") " pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.731603 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.731522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:01.872822 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:01.872792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"]
Jul 29 07:14:01.874395 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:14:01.874363    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7408dd12_2705_4542_aa59_8caf6ae08de8.slice/crio-6e946183d1b31947f68b25609c7f1bd09e4d701ebc0f0feee7cc73facdae0d89 WatchSource:0}: Error finding container 6e946183d1b31947f68b25609c7f1bd09e4d701ebc0f0feee7cc73facdae0d89: Status 404 returned error can't find the container with id 6e946183d1b31947f68b25609c7f1bd09e4d701ebc0f0feee7cc73facdae0d89
Jul 29 07:14:02.201612 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:02.201574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j" event={"ID":"7408dd12-2705-4542-aa59-8caf6ae08de8","Type":"ContainerStarted","Data":"7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249"}
Jul 29 07:14:02.201612 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:02.201614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j" event={"ID":"7408dd12-2705-4542-aa59-8caf6ae08de8","Type":"ContainerStarted","Data":"6e946183d1b31947f68b25609c7f1bd09e4d701ebc0f0feee7cc73facdae0d89"}
Jul 29 07:14:02.220921 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:02.220864    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j" podStartSLOduration=1.22084575 podStartE2EDuration="1.22084575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:14:02.218785755 +0000 UTC m=+3083.854377545" watchObservedRunningTime="2026-07-29 07:14:02.22084575 +0000 UTC m=+3083.856437560"
Jul 29 07:14:02.905686 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:02.905653    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d75de131-6012-496f-96ab-335523833313" path="/var/lib/kubelet/pods/d75de131-6012-496f-96ab-335523833313/volumes"
Jul 29 07:14:06.011012 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:06.010973    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:14:11.732357 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:11.732323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:11.732831 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:11.732405    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:11.744893 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:11.744873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:12.269721 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:12.269677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:14:27.605359 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:27.605316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:14:58.220884 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:14:58.220846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:15:00.131593 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.131518    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"]
Jul 29 07:15:00.135290 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.135263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"
Jul 29 07:15:00.137845 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.137822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:15:00.138094 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.138076    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"]
Jul 29 07:15:00.142288 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.142262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"
Jul 29 07:15:00.142548 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.142522    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"]
Jul 29 07:15:00.147232 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.147215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"
Jul 29 07:15:00.152691 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.152671    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"]
Jul 29 07:15:00.158549 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.158528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"
Jul 29 07:15:00.507297 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.507269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"]
Jul 29 07:15:00.509295 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:15:00.509266    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e27895_5beb_416c_a5b3_d3ab30e62342.slice/crio-1925373f3e9ab1bfe514d3903c5a51be6a25b57a1b5ac5dcfc63c47cf3e6f10c WatchSource:0}: Error finding container 1925373f3e9ab1bfe514d3903c5a51be6a25b57a1b5ac5dcfc63c47cf3e6f10c: Status 404 returned error can't find the container with id 1925373f3e9ab1bfe514d3903c5a51be6a25b57a1b5ac5dcfc63c47cf3e6f10c
Jul 29 07:15:00.542319 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.542277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt" event={"ID":"82e27895-5beb-416c-a5b3-d3ab30e62342","Type":"ContainerStarted","Data":"1925373f3e9ab1bfe514d3903c5a51be6a25b57a1b5ac5dcfc63c47cf3e6f10c"}
Jul 29 07:15:00.544768 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:00.544557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"]
Jul 29 07:15:00.547015 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:15:00.546993    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7c6352_e614_4cf8_9a69_a2e48c02ac3e.slice/crio-96357278f0f6415f0039d53ee246511112ead67ba44f8a08a6d0eed38d827302 WatchSource:0}: Error finding container 96357278f0f6415f0039d53ee246511112ead67ba44f8a08a6d0eed38d827302: Status 404 returned error can't find the container with id 96357278f0f6415f0039d53ee246511112ead67ba44f8a08a6d0eed38d827302
Jul 29 07:15:01.549139 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:01.549106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d" event={"ID":"ba7c6352-e614-4cf8-9a69-a2e48c02ac3e","Type":"ContainerStarted","Data":"b9db9e69dd6b26c886c77c6c64cae3ab344ccc13fb0749541c1b3e45d6a52594"}
Jul 29 07:15:01.549576 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:01.549168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d" event={"ID":"ba7c6352-e614-4cf8-9a69-a2e48c02ac3e","Type":"ContainerStarted","Data":"96357278f0f6415f0039d53ee246511112ead67ba44f8a08a6d0eed38d827302"}
Jul 29 07:15:01.550789 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:01.550764    2578 generic.go:356] "Generic (PLEG): container finished" podID="82e27895-5beb-416c-a5b3-d3ab30e62342" containerID="41f4946aa9cece3e7720b4ab4a112ebb3f3a6bf3084373e5736fd873ea6083c6" exitCode=0
Jul 29 07:15:01.550921 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:01.550863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt" event={"ID":"82e27895-5beb-416c-a5b3-d3ab30e62342","Type":"ContainerDied","Data":"41f4946aa9cece3e7720b4ab4a112ebb3f3a6bf3084373e5736fd873ea6083c6"}
Jul 29 07:15:01.565090 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:01.565033    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d" podStartSLOduration=1.565019109 podStartE2EDuration="1.565019109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:15:01.563558207 +0000 UTC m=+3143.199149998" watchObservedRunningTime="2026-07-29 07:15:01.565019109 +0000 UTC m=+3143.200610900"
Jul 29 07:15:02.558689 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:02.558652    2578 generic.go:356] "Generic (PLEG): container finished" podID="ba7c6352-e614-4cf8-9a69-a2e48c02ac3e" containerID="b9db9e69dd6b26c886c77c6c64cae3ab344ccc13fb0749541c1b3e45d6a52594" exitCode=0
Jul 29 07:15:02.559123 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:02.558754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d" event={"ID":"ba7c6352-e614-4cf8-9a69-a2e48c02ac3e","Type":"ContainerDied","Data":"b9db9e69dd6b26c886c77c6c64cae3ab344ccc13fb0749541c1b3e45d6a52594"}
Jul 29 07:15:02.715040 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:02.715014    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"
Jul 29 07:15:03.566165 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:03.566132    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt"
Jul 29 07:15:03.566555 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:03.566169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755155-qmcqt" event={"ID":"82e27895-5beb-416c-a5b3-d3ab30e62342","Type":"ContainerDied","Data":"1925373f3e9ab1bfe514d3903c5a51be6a25b57a1b5ac5dcfc63c47cf3e6f10c"}
Jul 29 07:15:03.566555 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:03.566215    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1925373f3e9ab1bfe514d3903c5a51be6a25b57a1b5ac5dcfc63c47cf3e6f10c"
Jul 29 07:15:03.719894 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:03.719860    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"
Jul 29 07:15:04.572810 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:04.572780    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"
Jul 29 07:15:04.573295 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:04.572807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d" event={"ID":"ba7c6352-e614-4cf8-9a69-a2e48c02ac3e","Type":"ContainerDied","Data":"96357278f0f6415f0039d53ee246511112ead67ba44f8a08a6d0eed38d827302"}
Jul 29 07:15:04.573295 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:04.572856    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96357278f0f6415f0039d53ee246511112ead67ba44f8a08a6d0eed38d827302"
Jul 29 07:15:18.220474 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:18.220429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:15:37.812352 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:37.812316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:15:44.122758 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:44.122704    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"]
Jul 29 07:15:51.822152 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:51.822111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:15:59.142606 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.142560    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j" podUID="7408dd12-2705-4542-aa59-8caf6ae08de8" containerName="main" containerID="cri-o://7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249" gracePeriod=45
Jul 29 07:15:59.394586 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.394523    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:15:59.561230 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-model-cache\") pod \"7408dd12-2705-4542-aa59-8caf6ae08de8\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") "
Jul 29 07:15:59.561393 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7408dd12-2705-4542-aa59-8caf6ae08de8-tls-certs\") pod \"7408dd12-2705-4542-aa59-8caf6ae08de8\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") "
Jul 29 07:15:59.561393 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561366    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-tmp-dir\") pod \"7408dd12-2705-4542-aa59-8caf6ae08de8\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") "
Jul 29 07:15:59.561521 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-dshm\") pod \"7408dd12-2705-4542-aa59-8caf6ae08de8\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") "
Jul 29 07:15:59.561521 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-home\") pod \"7408dd12-2705-4542-aa59-8caf6ae08de8\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") "
Jul 29 07:15:59.561521 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-model-cache" (OuterVolumeSpecName: "model-cache") pod "7408dd12-2705-4542-aa59-8caf6ae08de8" (UID: "7408dd12-2705-4542-aa59-8caf6ae08de8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:15:59.561521 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561474    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j277\" (UniqueName: \"kubernetes.io/projected/7408dd12-2705-4542-aa59-8caf6ae08de8-kube-api-access-6j277\") pod \"7408dd12-2705-4542-aa59-8caf6ae08de8\" (UID: \"7408dd12-2705-4542-aa59-8caf6ae08de8\") "
Jul 29 07:15:59.561766 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7408dd12-2705-4542-aa59-8caf6ae08de8" (UID: "7408dd12-2705-4542-aa59-8caf6ae08de8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:15:59.561766 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561652    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-home" (OuterVolumeSpecName: "home") pod "7408dd12-2705-4542-aa59-8caf6ae08de8" (UID: "7408dd12-2705-4542-aa59-8caf6ae08de8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:15:59.561895 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561834    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-tmp-dir\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:15:59.561895 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561853    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-home\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:15:59.561895 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.561862    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-model-cache\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:15:59.563658 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.563618    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-dshm" (OuterVolumeSpecName: "dshm") pod "7408dd12-2705-4542-aa59-8caf6ae08de8" (UID: "7408dd12-2705-4542-aa59-8caf6ae08de8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:15:59.563850 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.563749    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7408dd12-2705-4542-aa59-8caf6ae08de8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7408dd12-2705-4542-aa59-8caf6ae08de8" (UID: "7408dd12-2705-4542-aa59-8caf6ae08de8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 07:15:59.563850 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.563752    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7408dd12-2705-4542-aa59-8caf6ae08de8-kube-api-access-6j277" (OuterVolumeSpecName: "kube-api-access-6j277") pod "7408dd12-2705-4542-aa59-8caf6ae08de8" (UID: "7408dd12-2705-4542-aa59-8caf6ae08de8"). InnerVolumeSpecName "kube-api-access-6j277". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:15:59.567449 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567427    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"]
Jul 29 07:15:59.567857 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567844    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82e27895-5beb-416c-a5b3-d3ab30e62342" containerName="cleanup"
Jul 29 07:15:59.567911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567859    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82e27895-5beb-416c-a5b3-d3ab30e62342" containerName="cleanup"
Jul 29 07:15:59.567911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567868    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7408dd12-2705-4542-aa59-8caf6ae08de8" containerName="main"
Jul 29 07:15:59.567911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567873    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7408dd12-2705-4542-aa59-8caf6ae08de8" containerName="main"
Jul 29 07:15:59.567911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567895    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7c6352-e614-4cf8-9a69-a2e48c02ac3e" containerName="cleanup"
Jul 29 07:15:59.567911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567900    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7c6352-e614-4cf8-9a69-a2e48c02ac3e" containerName="cleanup"
Jul 29 07:15:59.568064 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567963    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82e27895-5beb-416c-a5b3-d3ab30e62342" containerName="cleanup"
Jul 29 07:15:59.568064 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567972    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7c6352-e614-4cf8-9a69-a2e48c02ac3e" containerName="cleanup"
Jul 29 07:15:59.568064 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.567980    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7408dd12-2705-4542-aa59-8caf6ae08de8" containerName="main"
Jul 29 07:15:59.571138 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.571122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.577768 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.577750    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50e693\"/\"rate-test-model-50e693-kserve-self-signed-certs\""
Jul 29 07:15:59.592016 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.591994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"]
Jul 29 07:15:59.663162 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k22q\" (UniqueName: \"kubernetes.io/projected/632ede5e-89ba-47e7-955b-dd271deb53b4-kube-api-access-5k22q\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.663162 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/632ede5e-89ba-47e7-955b-dd271deb53b4-tls-certs\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.663162 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-home\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.663442 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-model-cache\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.663442 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-dshm\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.663442 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-tmp-dir\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.663569 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663441    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j277\" (UniqueName: \"kubernetes.io/projected/7408dd12-2705-4542-aa59-8caf6ae08de8-kube-api-access-6j277\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:15:59.663569 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663457    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7408dd12-2705-4542-aa59-8caf6ae08de8-tls-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:15:59.663569 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.663473    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7408dd12-2705-4542-aa59-8caf6ae08de8-dshm\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:15:59.763917 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.763880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-tmp-dir\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764085 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.763936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k22q\" (UniqueName: \"kubernetes.io/projected/632ede5e-89ba-47e7-955b-dd271deb53b4-kube-api-access-5k22q\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764085 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.763966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/632ede5e-89ba-47e7-955b-dd271deb53b4-tls-certs\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764085 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.764010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-home\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764085 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.764061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-model-cache\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.764159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-dshm\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.764287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-tmp-dir\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764444 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.764368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-home\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.764588 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.764552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-model-cache\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.766698 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.766676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-dshm\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.767039 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.767022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/632ede5e-89ba-47e7-955b-dd271deb53b4-tls-certs\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.771973 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.771954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k22q\" (UniqueName: \"kubernetes.io/projected/632ede5e-89ba-47e7-955b-dd271deb53b4-kube-api-access-5k22q\") pod \"rate-test-model-50e693-kserve-678f4d84b7-jrqh2\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") " pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.885946 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.885910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:15:59.893497 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.893468    2578 generic.go:356] "Generic (PLEG): container finished" podID="7408dd12-2705-4542-aa59-8caf6ae08de8" containerID="7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249" exitCode=0
Jul 29 07:15:59.893632 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.893510    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"
Jul 29 07:15:59.893632 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.893548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j" event={"ID":"7408dd12-2705-4542-aa59-8caf6ae08de8","Type":"ContainerDied","Data":"7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249"}
Jul 29 07:15:59.893632 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.893596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j" event={"ID":"7408dd12-2705-4542-aa59-8caf6ae08de8","Type":"ContainerDied","Data":"6e946183d1b31947f68b25609c7f1bd09e4d701ebc0f0feee7cc73facdae0d89"}
Jul 29 07:15:59.893632 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.893618    2578 scope.go:117] "RemoveContainer" containerID="7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249"
Jul 29 07:15:59.902954 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.902938    2578 scope.go:117] "RemoveContainer" containerID="7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249"
Jul 29 07:15:59.903225 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:15:59.903204    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249\": container with ID starting with 7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249 not found: ID does not exist" containerID="7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249"
Jul 29 07:15:59.903309 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.903230    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249"} err="failed to get container status \"7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249\": rpc error: code = NotFound desc = could not find container \"7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249\": container with ID starting with 7341fb45a7efb92657eea2bbe081d501bcd46838c5c1fc2500d006314d5ce249 not found: ID does not exist"
Jul 29 07:15:59.915962 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.915902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"]
Jul 29 07:15:59.921052 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:15:59.921029    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/sub-test-model-50e693-kserve-78cfc44b67-rcz8j"]
Jul 29 07:16:00.026851 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:00.026821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"]
Jul 29 07:16:00.027740 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:16:00.027695    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod632ede5e_89ba_47e7_955b_dd271deb53b4.slice/crio-4fcf681e3c3fb371a7b80c7d6ffcc176aa62eed2b18d725fb35b013e304c4c19 WatchSource:0}: Error finding container 4fcf681e3c3fb371a7b80c7d6ffcc176aa62eed2b18d725fb35b013e304c4c19: Status 404 returned error can't find the container with id 4fcf681e3c3fb371a7b80c7d6ffcc176aa62eed2b18d725fb35b013e304c4c19
Jul 29 07:16:00.905145 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:00.905116    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7408dd12-2705-4542-aa59-8caf6ae08de8" path="/var/lib/kubelet/pods/7408dd12-2705-4542-aa59-8caf6ae08de8/volumes"
Jul 29 07:16:00.905526 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:00.905381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2" event={"ID":"632ede5e-89ba-47e7-955b-dd271deb53b4","Type":"ContainerStarted","Data":"b444b8427e94af656e844b8852a1fb3d350cb4e5802d95404a3b8dec16e7e10e"}
Jul 29 07:16:00.905526 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:00.905423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2" event={"ID":"632ede5e-89ba-47e7-955b-dd271deb53b4","Type":"ContainerStarted","Data":"4fcf681e3c3fb371a7b80c7d6ffcc176aa62eed2b18d725fb35b013e304c4c19"}
Jul 29 07:16:00.920023 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:00.919968    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2" podStartSLOduration=1.919951433 podStartE2EDuration="1.919951433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:16:00.919413996 +0000 UTC m=+3202.555005789" watchObservedRunningTime="2026-07-29 07:16:00.919951433 +0000 UTC m=+3202.555543225"
Jul 29 07:16:05.313939 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:05.313903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:16:09.886470 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:09.886430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:16:09.886928 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:09.886482    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:16:09.899233 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:09.899206    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:16:09.967024 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:09.966993    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:16:21.119969 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:21.119927    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:16:59.021571 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:16:59.021540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:17:18.818509 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:18.818474    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:17:38.415250 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:38.415218    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:17:39.159081 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:39.159053    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:17:39.164026 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:39.164003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:17:39.184590 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:39.184566    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:17:39.188849 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:39.188830    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:17:44.424441 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:44.424399    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"]
Jul 29 07:17:51.904159 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:51.904120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:17:59.444331 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.444262    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2" podUID="632ede5e-89ba-47e7-955b-dd271deb53b4" containerName="main" containerID="cri-o://b444b8427e94af656e844b8852a1fb3d350cb4e5802d95404a3b8dec16e7e10e" gracePeriod=45
Jul 29 07:17:59.601295 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.601265    2578 generic.go:356] "Generic (PLEG): container finished" podID="632ede5e-89ba-47e7-955b-dd271deb53b4" containerID="b444b8427e94af656e844b8852a1fb3d350cb4e5802d95404a3b8dec16e7e10e" exitCode=0
Jul 29 07:17:59.601472 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.601343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2" event={"ID":"632ede5e-89ba-47e7-955b-dd271deb53b4","Type":"ContainerDied","Data":"b444b8427e94af656e844b8852a1fb3d350cb4e5802d95404a3b8dec16e7e10e"}
Jul 29 07:17:59.703699 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.703629    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:17:59.732582 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732551    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-tmp-dir\") pod \"632ede5e-89ba-47e7-955b-dd271deb53b4\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") "
Jul 29 07:17:59.732582 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-home\") pod \"632ede5e-89ba-47e7-955b-dd271deb53b4\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") "
Jul 29 07:17:59.732828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732608    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/632ede5e-89ba-47e7-955b-dd271deb53b4-tls-certs\") pod \"632ede5e-89ba-47e7-955b-dd271deb53b4\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") "
Jul 29 07:17:59.732828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-dshm\") pod \"632ede5e-89ba-47e7-955b-dd271deb53b4\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") "
Jul 29 07:17:59.732828 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-model-cache\") pod \"632ede5e-89ba-47e7-955b-dd271deb53b4\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") "
Jul 29 07:17:59.733000 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k22q\" (UniqueName: \"kubernetes.io/projected/632ede5e-89ba-47e7-955b-dd271deb53b4-kube-api-access-5k22q\") pod \"632ede5e-89ba-47e7-955b-dd271deb53b4\" (UID: \"632ede5e-89ba-47e7-955b-dd271deb53b4\") "
Jul 29 07:17:59.733000 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732903    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-home" (OuterVolumeSpecName: "home") pod "632ede5e-89ba-47e7-955b-dd271deb53b4" (UID: "632ede5e-89ba-47e7-955b-dd271deb53b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:17:59.733000 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.732914    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "632ede5e-89ba-47e7-955b-dd271deb53b4" (UID: "632ede5e-89ba-47e7-955b-dd271deb53b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:17:59.733151 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.733002    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "632ede5e-89ba-47e7-955b-dd271deb53b4" (UID: "632ede5e-89ba-47e7-955b-dd271deb53b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:17:59.733207 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.733194    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-tmp-dir\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:17:59.733259 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.733211    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-home\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:17:59.733259 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.733225    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-model-cache\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:17:59.735081 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.735058    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/632ede5e-89ba-47e7-955b-dd271deb53b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "632ede5e-89ba-47e7-955b-dd271deb53b4" (UID: "632ede5e-89ba-47e7-955b-dd271deb53b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 07:17:59.735081 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.735066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-dshm" (OuterVolumeSpecName: "dshm") pod "632ede5e-89ba-47e7-955b-dd271deb53b4" (UID: "632ede5e-89ba-47e7-955b-dd271deb53b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:17:59.735288 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.735265    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/632ede5e-89ba-47e7-955b-dd271deb53b4-kube-api-access-5k22q" (OuterVolumeSpecName: "kube-api-access-5k22q") pod "632ede5e-89ba-47e7-955b-dd271deb53b4" (UID: "632ede5e-89ba-47e7-955b-dd271deb53b4"). InnerVolumeSpecName "kube-api-access-5k22q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:17:59.834214 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.834172    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/632ede5e-89ba-47e7-955b-dd271deb53b4-tls-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:17:59.834214 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.834204    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/632ede5e-89ba-47e7-955b-dd271deb53b4-dshm\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:17:59.834214 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:17:59.834220    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k22q\" (UniqueName: \"kubernetes.io/projected/632ede5e-89ba-47e7-955b-dd271deb53b4-kube-api-access-5k22q\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:18:00.608206 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:00.608165    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"
Jul 29 07:18:00.608206 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:00.608197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2" event={"ID":"632ede5e-89ba-47e7-955b-dd271deb53b4","Type":"ContainerDied","Data":"4fcf681e3c3fb371a7b80c7d6ffcc176aa62eed2b18d725fb35b013e304c4c19"}
Jul 29 07:18:00.608684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:00.608255    2578 scope.go:117] "RemoveContainer" containerID="b444b8427e94af656e844b8852a1fb3d350cb4e5802d95404a3b8dec16e7e10e"
Jul 29 07:18:00.629703 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:00.629665    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"]
Jul 29 07:18:00.633519 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:00.633492    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-50e693/rate-test-model-50e693-kserve-678f4d84b7-jrqh2"]
Jul 29 07:18:00.905102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:00.905070    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="632ede5e-89ba-47e7-955b-dd271deb53b4" path="/var/lib/kubelet/pods/632ede5e-89ba-47e7-955b-dd271deb53b4/volumes"
Jul 29 07:18:09.825999 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.825959    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"]
Jul 29 07:18:09.826591 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.826563    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="632ede5e-89ba-47e7-955b-dd271deb53b4" containerName="main"
Jul 29 07:18:09.826591 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.826583    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="632ede5e-89ba-47e7-955b-dd271deb53b4" containerName="main"
Jul 29 07:18:09.826745 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.826682    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="632ede5e-89ba-47e7-955b-dd271deb53b4" containerName="main"
Jul 29 07:18:09.831339 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.831317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:09.835354 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.835333    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-aab086\""
Jul 29 07:18:09.835511 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.835338    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-aab086-dockercfg-r4j5b\""
Jul 29 07:18:09.843922 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.843898    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"]
Jul 29 07:18:09.858916 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.858883    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"]
Jul 29 07:18:09.862458 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.862438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:09.871514 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.871494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"]
Jul 29 07:18:09.923882 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.923850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7rfg\" (UniqueName: \"kubernetes.io/projected/4c563e29-153b-4bc4-a890-bc77b5bed594-kube-api-access-p7rfg\") pod \"payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:09.924059 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.923908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c563e29-153b-4bc4-a890-bc77b5bed594-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:09.924059 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.923984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhw7\" (UniqueName: \"kubernetes.io/projected/ae153060-5bd2-4506-a705-098a63a42564-kube-api-access-jrhw7\") pod \"payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:09.924059 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:09.924058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae153060-5bd2-4506-a705-098a63a42564-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.025182 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.025140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae153060-5bd2-4506-a705-098a63a42564-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.025391 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.025206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7rfg\" (UniqueName: \"kubernetes.io/projected/4c563e29-153b-4bc4-a890-bc77b5bed594-kube-api-access-p7rfg\") pod \"payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:10.025391 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.025248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c563e29-153b-4bc4-a890-bc77b5bed594-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:10.025391 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.025287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhw7\" (UniqueName: \"kubernetes.io/projected/ae153060-5bd2-4506-a705-098a63a42564-kube-api-access-jrhw7\") pod \"payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.025906 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.025888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae153060-5bd2-4506-a705-098a63a42564-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.026036 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.026018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c563e29-153b-4bc4-a890-bc77b5bed594-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:10.033525 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.033502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhw7\" (UniqueName: \"kubernetes.io/projected/ae153060-5bd2-4506-a705-098a63a42564-kube-api-access-jrhw7\") pod \"payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.033633 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.033579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7rfg\" (UniqueName: \"kubernetes.io/projected/4c563e29-153b-4bc4-a890-bc77b5bed594-kube-api-access-p7rfg\") pod \"payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:10.143482 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.143445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.173577 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.173546    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:10.312025 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:18:10.311978    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae153060_5bd2_4506_a705_098a63a42564.slice/crio-835afb6101004f4cd3175084320a9ea385f1222289b0af66df51e4a08b6f49ed WatchSource:0}: Error finding container 835afb6101004f4cd3175084320a9ea385f1222289b0af66df51e4a08b6f49ed: Status 404 returned error can't find the container with id 835afb6101004f4cd3175084320a9ea385f1222289b0af66df51e4a08b6f49ed
Jul 29 07:18:10.312360 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.312333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"]
Jul 29 07:18:10.337163 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.337140    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"]
Jul 29 07:18:10.345939 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:18:10.345914    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c563e29_153b_4bc4_a890_bc77b5bed594.slice/crio-7180d09cd2db3b21ac90f554669e73287871186a0131add12865b6063f3237ee WatchSource:0}: Error finding container 7180d09cd2db3b21ac90f554669e73287871186a0131add12865b6063f3237ee: Status 404 returned error can't find the container with id 7180d09cd2db3b21ac90f554669e73287871186a0131add12865b6063f3237ee
Jul 29 07:18:10.677767 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.677643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp" event={"ID":"4c563e29-153b-4bc4-a890-bc77b5bed594","Type":"ContainerStarted","Data":"3c69b2b7174645571c12e51d31aa6ebe175e4af99829b4573f0e7ad90d258ac5"}
Jul 29 07:18:10.677767 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.677702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp" event={"ID":"4c563e29-153b-4bc4-a890-bc77b5bed594","Type":"ContainerStarted","Data":"7180d09cd2db3b21ac90f554669e73287871186a0131add12865b6063f3237ee"}
Jul 29 07:18:10.678049 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.677854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:10.679391 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.679366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl" event={"ID":"ae153060-5bd2-4506-a705-098a63a42564","Type":"ContainerStarted","Data":"2ccb3bcd05cd725e1d440fa95ed9317b9de9be21e6e72669a60ccde7243b0865"}
Jul 29 07:18:10.679512 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.679415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl" event={"ID":"ae153060-5bd2-4506-a705-098a63a42564","Type":"ContainerStarted","Data":"835afb6101004f4cd3175084320a9ea385f1222289b0af66df51e4a08b6f49ed"}
Jul 29 07:18:10.679512 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.679444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:10.707629 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.707579    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp" podStartSLOduration=1.707564916 podStartE2EDuration="1.707564916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:18:10.706771372 +0000 UTC m=+3332.342363162" watchObservedRunningTime="2026-07-29 07:18:10.707564916 +0000 UTC m=+3332.343156706"
Jul 29 07:18:10.725397 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:10.725343    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl" podStartSLOduration=1.725326079 podStartE2EDuration="1.725326079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:18:10.724792215 +0000 UTC m=+3332.360384026" watchObservedRunningTime="2026-07-29 07:18:10.725326079 +0000 UTC m=+3332.360917869"
Jul 29 07:18:18.012725 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:18.012678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:18:21.687854 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:21.687818    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:18:21.692158 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:21.687898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:18:43.291610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.291571    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d6862"]
Jul 29 07:18:43.296780 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.296762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:43.299636 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.299612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m4rrf\""
Jul 29 07:18:43.304330 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.304076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d6862"]
Jul 29 07:18:43.325937 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.325910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgxq\" (UniqueName: \"kubernetes.io/projected/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9-kube-api-access-qsgxq\") pod \"kuadrant-operator-catalog-d6862\" (UID: \"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9\") " pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:43.426559 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.426510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgxq\" (UniqueName: \"kubernetes.io/projected/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9-kube-api-access-qsgxq\") pod \"kuadrant-operator-catalog-d6862\" (UID: \"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9\") " pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:43.435253 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.435223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgxq\" (UniqueName: \"kubernetes.io/projected/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9-kube-api-access-qsgxq\") pod \"kuadrant-operator-catalog-d6862\" (UID: \"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9\") " pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:43.607424 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.607324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:43.749296 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.746639    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d6862"]
Jul 29 07:18:43.749950 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:18:43.749919    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49d4ac5_39e1_4a12_a6b5_e789bfc40ca9.slice/crio-61469212b10191c35d76b278e81113c86f63b83a48429e63fdefcc05b31129cb WatchSource:0}: Error finding container 61469212b10191c35d76b278e81113c86f63b83a48429e63fdefcc05b31129cb: Status 404 returned error can't find the container with id 61469212b10191c35d76b278e81113c86f63b83a48429e63fdefcc05b31129cb
Jul 29 07:18:43.751591 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.751568    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 07:18:43.880922 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:43.880885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d6862" event={"ID":"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9","Type":"ContainerStarted","Data":"61469212b10191c35d76b278e81113c86f63b83a48429e63fdefcc05b31129cb"}
Jul 29 07:18:45.895256 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:45.895222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d6862" event={"ID":"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9","Type":"ContainerStarted","Data":"033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e"}
Jul 29 07:18:45.914133 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:45.914082    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d6862" podStartSLOduration=1.383770706 podStartE2EDuration="2.914068008s" totalImagesPullingTime="1.530297302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:18:45.910931914 +0000 UTC m=+3367.546523704" watchObservedRunningTime="2026-07-29 07:18:45.914068008 +0000 UTC m=+3367.549659799"
Jul 29 07:18:48.011047 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:48.011014    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:18:53.607895 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:53.607856    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:53.608348 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:53.607950    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:53.630572 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:53.630534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:53.963215 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:53.963187    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:54.002202 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:54.002172    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d6862"]
Jul 29 07:18:55.951861 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:55.951822    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d6862" podUID="e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" containerName="registry-server" containerID="cri-o://033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e" gracePeriod=2
Jul 29 07:18:56.217118 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.217054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:56.346323 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.346292    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsgxq\" (UniqueName: \"kubernetes.io/projected/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9-kube-api-access-qsgxq\") pod \"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9\" (UID: \"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9\") "
Jul 29 07:18:56.348444 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.348420    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9-kube-api-access-qsgxq" (OuterVolumeSpecName: "kube-api-access-qsgxq") pod "e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" (UID: "e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9"). InnerVolumeSpecName "kube-api-access-qsgxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:18:56.447308 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.447269    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsgxq\" (UniqueName: \"kubernetes.io/projected/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9-kube-api-access-qsgxq\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:18:56.958986 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.958953    2578 generic.go:356] "Generic (PLEG): container finished" podID="e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" containerID="033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e" exitCode=0
Jul 29 07:18:56.959389 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.959018    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d6862"
Jul 29 07:18:56.959389 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.959045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d6862" event={"ID":"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9","Type":"ContainerDied","Data":"033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e"}
Jul 29 07:18:56.959389 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.959098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d6862" event={"ID":"e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9","Type":"ContainerDied","Data":"61469212b10191c35d76b278e81113c86f63b83a48429e63fdefcc05b31129cb"}
Jul 29 07:18:56.959389 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.959119    2578 scope.go:117] "RemoveContainer" containerID="033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e"
Jul 29 07:18:56.968925 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.968911    2578 scope.go:117] "RemoveContainer" containerID="033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e"
Jul 29 07:18:56.969172 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:18:56.969156    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e\": container with ID starting with 033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e not found: ID does not exist" containerID="033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e"
Jul 29 07:18:56.969217 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.969182    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e"} err="failed to get container status \"033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e\": rpc error: code = NotFound desc = could not find container \"033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e\": container with ID starting with 033f5adfb4e0b9b067d5b560088a85b2522bd52ddd1bccd1362ad1e04d4d4d5e not found: ID does not exist"
Jul 29 07:18:56.978174 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.978146    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d6862"]
Jul 29 07:18:56.981956 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:56.981936    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d6862"]
Jul 29 07:18:58.906278 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:18:58.906244    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" path="/var/lib/kubelet/pods/e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9/volumes"
Jul 29 07:19:16.911870 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.911839    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"]
Jul 29 07:19:16.912874 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.912850    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" containerName="registry-server"
Jul 29 07:19:16.912874 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.912875    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" containerName="registry-server"
Jul 29 07:19:16.913072 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.912976    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49d4ac5-39e1-4a12-a6b5-e789bfc40ca9" containerName="registry-server"
Jul 29 07:19:16.916068 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.916050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:16.919531 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.919511    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-aab086\"/\"openshift-service-ca.crt\""
Jul 29 07:19:16.919633 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.919511    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-aab086\"/\"default-dockercfg-qjlxb\""
Jul 29 07:19:16.919814 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.919519    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-aab086\"/\"ipp-route-aab086-kserve-self-signed-certs\""
Jul 29 07:19:16.920254 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.920232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-aab086\"/\"kube-root-ca.crt\""
Jul 29 07:19:16.926583 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:16.926559    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"]
Jul 29 07:19:17.037227 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.037192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-model-cache\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.037403 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.037290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-dshm\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.037403 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.037326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcea859-d20b-498b-b7c1-98308ce859e4-tls-certs\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.037403 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.037386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-home\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.037516 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.037471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-tmp-dir\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.037516 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.037488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbs7\" (UniqueName: \"kubernetes.io/projected/9bcea859-d20b-498b-b7c1-98308ce859e4-kube-api-access-9vbs7\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.138848 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.138806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-model-cache\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139038 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.138871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-dshm\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139038 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.138894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcea859-d20b-498b-b7c1-98308ce859e4-tls-certs\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139038 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.138936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-home\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139038 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.138970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-tmp-dir\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139269 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.139078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbs7\" (UniqueName: \"kubernetes.io/projected/9bcea859-d20b-498b-b7c1-98308ce859e4-kube-api-access-9vbs7\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.139266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-model-cache\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139392 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.139329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-tmp-dir\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.139442 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.139389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-home\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.141380 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.141359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-dshm\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.141530 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.141516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcea859-d20b-498b-b7c1-98308ce859e4-tls-certs\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.154406 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.154378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbs7\" (UniqueName: \"kubernetes.io/projected/9bcea859-d20b-498b-b7c1-98308ce859e4-kube-api-access-9vbs7\") pod \"ipp-route-aab086-kserve-66b46f9-kkscl\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") " pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.227726 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.227614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:17.377193 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:17.377167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"]
Jul 29 07:19:17.378146 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:19:17.378123    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bcea859_d20b_498b_b7c1_98308ce859e4.slice/crio-a49c9ac5f460836dfad388ef6b70777f97ebcbdf5a15f10effb9483a3f2473fa WatchSource:0}: Error finding container a49c9ac5f460836dfad388ef6b70777f97ebcbdf5a15f10effb9483a3f2473fa: Status 404 returned error can't find the container with id a49c9ac5f460836dfad388ef6b70777f97ebcbdf5a15f10effb9483a3f2473fa
Jul 29 07:19:18.084028 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:18.083986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl" event={"ID":"9bcea859-d20b-498b-b7c1-98308ce859e4","Type":"ContainerStarted","Data":"467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a"}
Jul 29 07:19:18.084028 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:18.084036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl" event={"ID":"9bcea859-d20b-498b-b7c1-98308ce859e4","Type":"ContainerStarted","Data":"a49c9ac5f460836dfad388ef6b70777f97ebcbdf5a15f10effb9483a3f2473fa"}
Jul 29 07:19:18.114506 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:18.114450    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl" podStartSLOduration=2.114435428 podStartE2EDuration="2.114435428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:19:18.112504187 +0000 UTC m=+3399.748095978" watchObservedRunningTime="2026-07-29 07:19:18.114435428 +0000 UTC m=+3399.750027220"
Jul 29 07:19:20.325282 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:20.325242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:19:27.228595 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:27.228565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:27.229077 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:27.228610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:27.240971 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:27.240947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:28.150600 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:28.150573    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:19:49.844827 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:19:49.844792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:20:00.086631 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:00.086576    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp_4c563e29-153b-4bc4-a890-bc77b5bed594/payload-processing/0.log"
Jul 29 07:20:00.946008 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:00.945972    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"]
Jul 29 07:20:00.958019 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:00.957978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:00.961658 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:00.961625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-43705a-openshift-default-dockercfg-cc8rt\""
Jul 29 07:20:00.978392 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:00.978364    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"]
Jul 29 07:20:01.141991 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.141956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh7mx\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-kube-api-access-wh7mx\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-certs\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-socket\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-envoy\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-data\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-token\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-credential-socket\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.142443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.142332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-podinfo\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243394 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-socket\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243394 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-envoy\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243394 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-data\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243690 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243690 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-token\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243690 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-credential-socket\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243690 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-podinfo\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243690 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh7mx\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-kube-api-access-wh7mx\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.243690 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-certs\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.244040 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-socket\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.244040 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-data\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.244040 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.243927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-certs\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.244147 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.244098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-credential-socket\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.244240 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.244218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.245928 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.245905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-envoy\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.246337 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.246320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-podinfo\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.252570 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.252547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-token\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.252839 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.252816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh7mx\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-kube-api-access-wh7mx\") pod \"e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") " pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.271218 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.271186    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:01.431466 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:01.431441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"]
Jul 29 07:20:01.433663 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:20:01.433631    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30f38f8_3013_4ef5_967b_ff1cbad0981f.slice/crio-a9d83144371e71bed472cf1b830061860e28a837f5a44d8479a8c2506f04566b WatchSource:0}: Error finding container a9d83144371e71bed472cf1b830061860e28a837f5a44d8479a8c2506f04566b: Status 404 returned error can't find the container with id a9d83144371e71bed472cf1b830061860e28a837f5a44d8479a8c2506f04566b
Jul 29 07:20:02.333030 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:02.332991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" event={"ID":"f30f38f8-3013-4ef5-967b-ff1cbad0981f","Type":"ContainerStarted","Data":"a9d83144371e71bed472cf1b830061860e28a837f5a44d8479a8c2506f04566b"}
Jul 29 07:20:04.680010 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:04.679972    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 07:20:04.680329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:04.680046    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 07:20:04.680329 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:04.680078    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 07:20:05.354638 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:05.354596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" event={"ID":"f30f38f8-3013-4ef5-967b-ff1cbad0981f","Type":"ContainerStarted","Data":"d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"}
Jul 29 07:20:05.377193 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:05.377141    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" podStartSLOduration=2.133237124 podStartE2EDuration="5.377125088s" totalImagesPullingTime="3.243887964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:20:05.375532028 +0000 UTC m=+3447.011123829" watchObservedRunningTime="2026-07-29 07:20:05.377125088 +0000 UTC m=+3447.012716878"
Jul 29 07:20:06.271672 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:06.271634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:06.276676 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:06.276648    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:06.360623 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:06.360590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:06.361676 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:06.361655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:08.172509 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.172446    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"]
Jul 29 07:20:08.176443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.176420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.179426 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.179405    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-43705a-dockercfg-tz87s\""
Jul 29 07:20:08.179502 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.179417    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-43705a\""
Jul 29 07:20:08.188503 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.188475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"]
Jul 29 07:20:08.210917 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.210882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9hsv\" (UniqueName: \"kubernetes.io/projected/adc82f75-07c4-4341-beed-798778eabf91-kube-api-access-p9hsv\") pod \"payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.211135 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.210946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc82f75-07c4-4341-beed-798778eabf91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.312106 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.312072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc82f75-07c4-4341-beed-798778eabf91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.312301 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.312185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9hsv\" (UniqueName: \"kubernetes.io/projected/adc82f75-07c4-4341-beed-798778eabf91-kube-api-access-p9hsv\") pod \"payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.312944 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.312918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc82f75-07c4-4341-beed-798778eabf91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.321290 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.321263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9hsv\" (UniqueName: \"kubernetes.io/projected/adc82f75-07c4-4341-beed-798778eabf91-kube-api-access-p9hsv\") pod \"payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.488148 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.488057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:08.634933 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:08.634907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"]
Jul 29 07:20:08.637784 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:20:08.637757    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc82f75_07c4_4341_beed_798778eabf91.slice/crio-59532a2a13ae4476c709efde188e56d23b5e83efba0e20621eb3a85576a03c34 WatchSource:0}: Error finding container 59532a2a13ae4476c709efde188e56d23b5e83efba0e20621eb3a85576a03c34: Status 404 returned error can't find the container with id 59532a2a13ae4476c709efde188e56d23b5e83efba0e20621eb3a85576a03c34
Jul 29 07:20:09.379869 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:09.379832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg" event={"ID":"adc82f75-07c4-4341-beed-798778eabf91","Type":"ContainerStarted","Data":"67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7"}
Jul 29 07:20:09.380254 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:09.379884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg" event={"ID":"adc82f75-07c4-4341-beed-798778eabf91","Type":"ContainerStarted","Data":"59532a2a13ae4476c709efde188e56d23b5e83efba0e20621eb3a85576a03c34"}
Jul 29 07:20:09.380254 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:09.379930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:09.398410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:09.398357    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg" podStartSLOduration=1.398338752 podStartE2EDuration="1.398338752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:20:09.39587814 +0000 UTC m=+3451.031469948" watchObservedRunningTime="2026-07-29 07:20:09.398338752 +0000 UTC m=+3451.033930543"
Jul 29 07:20:20.389154 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:20.389121    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:21.209177 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:21.209146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:20:30.514436 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:30.514400    2578 generic.go:356] "Generic (PLEG): container finished" podID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerID="d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a" exitCode=0
Jul 29 07:20:30.514955 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:30.514475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" event={"ID":"f30f38f8-3013-4ef5-967b-ff1cbad0981f","Type":"ContainerDied","Data":"d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"}
Jul 29 07:20:30.514955 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:30.514898    2578 scope.go:117] "RemoveContainer" containerID="d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"
Jul 29 07:20:30.515979 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:30.515952    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 07:20:30.516049 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:30.516021    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 07:20:30.516086 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:30.516052    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 07:20:31.522121 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:31.522087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" event={"ID":"f30f38f8-3013-4ef5-967b-ff1cbad0981f","Type":"ContainerStarted","Data":"4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1"}
Jul 29 07:20:32.273640 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:32.273605    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:32.274090 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:32.274062    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 29 07:20:32.274289 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:32.274263    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 29 07:20:33.145829 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.145793    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"]
Jul 29 07:20:33.148621 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.148605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:33.151485 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.151452    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:20:33.151701 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.151681    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:20:33.158606 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.158569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"]
Jul 29 07:20:33.255233 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.255189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4693e97-d1b4-47e2-89a2-06cb43cc5efa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b\" (UID: \"d4693e97-d1b4-47e2-89a2-06cb43cc5efa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:33.273122 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.273078    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 29 07:20:33.273309 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.273151    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 29 07:20:33.356300 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.356252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4693e97-d1b4-47e2-89a2-06cb43cc5efa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b\" (UID: \"d4693e97-d1b4-47e2-89a2-06cb43cc5efa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:33.357112 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.357088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4693e97-d1b4-47e2-89a2-06cb43cc5efa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b\" (UID: \"d4693e97-d1b4-47e2-89a2-06cb43cc5efa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:33.476952 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.476858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:33.646555 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:33.646513    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"]
Jul 29 07:20:33.648115 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:20:33.648081    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4693e97_d1b4_47e2_89a2_06cb43cc5efa.slice/crio-782734e148de16374533dcc48a696273ea292d6cab62e7cd2878743846a95794 WatchSource:0}: Error finding container 782734e148de16374533dcc48a696273ea292d6cab62e7cd2878743846a95794: Status 404 returned error can't find the container with id 782734e148de16374533dcc48a696273ea292d6cab62e7cd2878743846a95794
Jul 29 07:20:34.272522 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:34.272420    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 29 07:20:34.272522 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:34.272490    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 29 07:20:34.542592 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:34.542481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b" event={"ID":"d4693e97-d1b4-47e2-89a2-06cb43cc5efa","Type":"ContainerStarted","Data":"20bfbe98fb00bdbbb6d56c09ec40281b493b4178df5fdd12b3455be394d7e376"}
Jul 29 07:20:34.542592 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:34.542555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b" event={"ID":"d4693e97-d1b4-47e2-89a2-06cb43cc5efa","Type":"ContainerStarted","Data":"782734e148de16374533dcc48a696273ea292d6cab62e7cd2878743846a95794"}
Jul 29 07:20:34.581296 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:34.581250    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b" podStartSLOduration=1.581233196 podStartE2EDuration="1.581233196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:20:34.577826496 +0000 UTC m=+3476.213418288" watchObservedRunningTime="2026-07-29 07:20:34.581233196 +0000 UTC m=+3476.216824964"
Jul 29 07:20:35.272405 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:35.271970    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 29 07:20:35.272405 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:35.272031    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 29 07:20:35.550520 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:35.550433    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4693e97-d1b4-47e2-89a2-06cb43cc5efa" containerID="20bfbe98fb00bdbbb6d56c09ec40281b493b4178df5fdd12b3455be394d7e376" exitCode=0
Jul 29 07:20:35.550689 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:35.550518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b" event={"ID":"d4693e97-d1b4-47e2-89a2-06cb43cc5efa","Type":"ContainerDied","Data":"20bfbe98fb00bdbbb6d56c09ec40281b493b4178df5fdd12b3455be394d7e376"}
Jul 29 07:20:36.275397 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.275366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:36.275817 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.275777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:36.276363 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.276348    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:20:36.701497 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.701472    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:36.803780 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.803752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4693e97-d1b4-47e2-89a2-06cb43cc5efa-maas-api-service-ca\") pod \"d4693e97-d1b4-47e2-89a2-06cb43cc5efa\" (UID: \"d4693e97-d1b4-47e2-89a2-06cb43cc5efa\") "
Jul 29 07:20:36.804058 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.804036    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4693e97-d1b4-47e2-89a2-06cb43cc5efa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d4693e97-d1b4-47e2-89a2-06cb43cc5efa" (UID: "d4693e97-d1b4-47e2-89a2-06cb43cc5efa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:20:36.905238 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:36.905212    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4693e97-d1b4-47e2-89a2-06cb43cc5efa-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:20:37.563617 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:37.563590    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"
Jul 29 07:20:37.564119 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:37.563650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b" event={"ID":"d4693e97-d1b4-47e2-89a2-06cb43cc5efa","Type":"ContainerDied","Data":"782734e148de16374533dcc48a696273ea292d6cab62e7cd2878743846a95794"}
Jul 29 07:20:37.564119 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:37.563696    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="782734e148de16374533dcc48a696273ea292d6cab62e7cd2878743846a95794"
Jul 29 07:20:48.180506 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.180471    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"]
Jul 29 07:20:48.180980 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.180743    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg" podUID="adc82f75-07c4-4341-beed-798778eabf91" containerName="payload-pre-processing" containerID="cri-o://67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7" gracePeriod=30
Jul 29 07:20:48.336236 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.336204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"]
Jul 29 07:20:48.338952 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.338920    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-43705a-bzq5b"]
Jul 29 07:20:48.460112 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.460079    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:48.501861 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.501834    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc82f75-07c4-4341-beed-798778eabf91-plugins-config-volume\") pod \"adc82f75-07c4-4341-beed-798778eabf91\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") "
Jul 29 07:20:48.502017 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.501873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9hsv\" (UniqueName: \"kubernetes.io/projected/adc82f75-07c4-4341-beed-798778eabf91-kube-api-access-p9hsv\") pod \"adc82f75-07c4-4341-beed-798778eabf91\" (UID: \"adc82f75-07c4-4341-beed-798778eabf91\") "
Jul 29 07:20:48.502260 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.502236    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc82f75-07c4-4341-beed-798778eabf91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "adc82f75-07c4-4341-beed-798778eabf91" (UID: "adc82f75-07c4-4341-beed-798778eabf91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:20:48.504100 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.504078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc82f75-07c4-4341-beed-798778eabf91-kube-api-access-p9hsv" (OuterVolumeSpecName: "kube-api-access-p9hsv") pod "adc82f75-07c4-4341-beed-798778eabf91" (UID: "adc82f75-07c4-4341-beed-798778eabf91"). InnerVolumeSpecName "kube-api-access-p9hsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:20:48.603488 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.603449    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc82f75-07c4-4341-beed-798778eabf91-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:20:48.603488 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.603479    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9hsv\" (UniqueName: \"kubernetes.io/projected/adc82f75-07c4-4341-beed-798778eabf91-kube-api-access-p9hsv\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:20:48.638528 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.638500    2578 generic.go:356] "Generic (PLEG): container finished" podID="adc82f75-07c4-4341-beed-798778eabf91" containerID="67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7" exitCode=0
Jul 29 07:20:48.638702 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.638545    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"
Jul 29 07:20:48.638702 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.638596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg" event={"ID":"adc82f75-07c4-4341-beed-798778eabf91","Type":"ContainerDied","Data":"67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7"}
Jul 29 07:20:48.638702 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.638648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg" event={"ID":"adc82f75-07c4-4341-beed-798778eabf91","Type":"ContainerDied","Data":"59532a2a13ae4476c709efde188e56d23b5e83efba0e20621eb3a85576a03c34"}
Jul 29 07:20:48.638702 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.638670    2578 scope.go:117] "RemoveContainer" containerID="67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7"
Jul 29 07:20:48.648439 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.648417    2578 scope.go:117] "RemoveContainer" containerID="67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7"
Jul 29 07:20:48.648677 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:20:48.648660    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7\": container with ID starting with 67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7 not found: ID does not exist" containerID="67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7"
Jul 29 07:20:48.648768 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.648685    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7"} err="failed to get container status \"67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7\": rpc error: code = NotFound desc = could not find container \"67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7\": container with ID starting with 67654514900ad1603617b0985ee5e4083b2da4b8b14fee2b4b1b5088a6eb51f7 not found: ID does not exist"
Jul 29 07:20:48.677476 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.677448    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"]
Jul 29 07:20:48.682186 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.682164    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg"]
Jul 29 07:20:48.905881 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.905854    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc82f75-07c4-4341-beed-798778eabf91" path="/var/lib/kubelet/pods/adc82f75-07c4-4341-beed-798778eabf91/volumes"
Jul 29 07:20:48.906169 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:48.906157    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4693e97-d1b4-47e2-89a2-06cb43cc5efa" path="/var/lib/kubelet/pods/d4693e97-d1b4-47e2-89a2-06cb43cc5efa/volumes"
Jul 29 07:20:52.114220 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:52.114189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:20:55.003335 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:55.003294    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"]
Jul 29 07:20:55.004270 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:20:55.004179    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy" containerID="cri-o://4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1" gracePeriod=30
Jul 29 07:21:00.277675 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.277619    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:21:00.309035 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istiod-ca-cert\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-socket\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309083    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-certs\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh7mx\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-kube-api-access-wh7mx\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-token\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309178    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-podinfo\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309234 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-data\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.309831 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309663    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:21:00.309913 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:00.309913 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.309776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.310200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-envoy\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.310267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-credential-socket\") pod \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\" (UID: \"f30f38f8-3013-4ef5-967b-ff1cbad0981f\") "
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.310747    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-data" (OuterVolumeSpecName: "istio-data") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.310878    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.310909    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-workload-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.310922    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istiod-ca-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.319211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.311248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:00.319773 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.319681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-token" (OuterVolumeSpecName: "istio-token") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:21:00.319773 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.319730    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 07:21:00.321410 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.321381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-kube-api-access-wh7mx" (OuterVolumeSpecName: "kube-api-access-wh7mx") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "kube-api-access-wh7mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:21:00.321533 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.321523    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f30f38f8-3013-4ef5-967b-ff1cbad0981f" (UID: "f30f38f8-3013-4ef5-967b-ff1cbad0981f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:00.412348 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.412301    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh7mx\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-kube-api-access-wh7mx\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.412610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.412359    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-token\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.412610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.412372    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-podinfo\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.412610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.412385    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-data\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.412610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.412396    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-istio-envoy\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.412610 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.412408    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30f38f8-3013-4ef5-967b-ff1cbad0981f-credential-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:00.711995 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.711962    2578 generic.go:356] "Generic (PLEG): container finished" podID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerID="4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1" exitCode=0
Jul 29 07:21:00.712174 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.712001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" event={"ID":"f30f38f8-3013-4ef5-967b-ff1cbad0981f","Type":"ContainerDied","Data":"4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1"}
Jul 29 07:21:00.712174 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.712035    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"
Jul 29 07:21:00.712174 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.712070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4" event={"ID":"f30f38f8-3013-4ef5-967b-ff1cbad0981f","Type":"ContainerDied","Data":"a9d83144371e71bed472cf1b830061860e28a837f5a44d8479a8c2506f04566b"}
Jul 29 07:21:00.712174 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.712092    2578 scope.go:117] "RemoveContainer" containerID="4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1"
Jul 29 07:21:00.721942 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.721924    2578 scope.go:117] "RemoveContainer" containerID="d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"
Jul 29 07:21:00.730791 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.730770    2578 scope.go:117] "RemoveContainer" containerID="4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1"
Jul 29 07:21:00.731070 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:21:00.731049    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1\": container with ID starting with 4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1 not found: ID does not exist" containerID="4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1"
Jul 29 07:21:00.731143 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.731078    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1"} err="failed to get container status \"4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1\": rpc error: code = NotFound desc = could not find container \"4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1\": container with ID starting with 4052585a510cbaac5aa357be5b6c419360861718e29c202b788c1367194c72a1 not found: ID does not exist"
Jul 29 07:21:00.731143 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.731096    2578 scope.go:117] "RemoveContainer" containerID="d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"
Jul 29 07:21:00.731358 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:21:00.731327    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a\": container with ID starting with d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a not found: ID does not exist" containerID="d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"
Jul 29 07:21:00.731456 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.731362    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a"} err="failed to get container status \"d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a\": rpc error: code = NotFound desc = could not find container \"d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a\": container with ID starting with d43314dc667ed555d95694edea21a797084eda9b730b3c9121d015e4e0b9921a not found: ID does not exist"
Jul 29 07:21:00.735067 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.735042    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"]
Jul 29 07:21:00.738539 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.738505    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4"]
Jul 29 07:21:00.904788 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:00.904753    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" path="/var/lib/kubelet/pods/f30f38f8-3013-4ef5-967b-ff1cbad0981f/volumes"
Jul 29 07:21:14.318801 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.318767    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:21:14.589209 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.589109    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"]
Jul 29 07:21:14.589452 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.589404    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp" podUID="4c563e29-153b-4bc4-a890-bc77b5bed594" containerName="payload-processing" containerID="cri-o://3c69b2b7174645571c12e51d31aa6ebe175e4af99829b4573f0e7ad90d258ac5" gracePeriod=30
Jul 29 07:21:14.593763 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.593740    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"]
Jul 29 07:21:14.593989 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.593965    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl" podUID="ae153060-5bd2-4506-a705-098a63a42564" containerName="payload-pre-processing" containerID="cri-o://2ccb3bcd05cd725e1d440fa95ed9317b9de9be21e6e72669a60ccde7243b0865" gracePeriod=30
Jul 29 07:21:14.796283 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.796255    2578 generic.go:356] "Generic (PLEG): container finished" podID="4c563e29-153b-4bc4-a890-bc77b5bed594" containerID="3c69b2b7174645571c12e51d31aa6ebe175e4af99829b4573f0e7ad90d258ac5" exitCode=0
Jul 29 07:21:14.796449 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.796328    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp" event={"ID":"4c563e29-153b-4bc4-a890-bc77b5bed594","Type":"ContainerDied","Data":"3c69b2b7174645571c12e51d31aa6ebe175e4af99829b4573f0e7ad90d258ac5"}
Jul 29 07:21:14.801911 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.801882    2578 generic.go:356] "Generic (PLEG): container finished" podID="ae153060-5bd2-4506-a705-098a63a42564" containerID="2ccb3bcd05cd725e1d440fa95ed9317b9de9be21e6e72669a60ccde7243b0865" exitCode=0
Jul 29 07:21:14.802063 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.801960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl" event={"ID":"ae153060-5bd2-4506-a705-098a63a42564","Type":"ContainerDied","Data":"2ccb3bcd05cd725e1d440fa95ed9317b9de9be21e6e72669a60ccde7243b0865"}
Jul 29 07:21:14.888568 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.888545    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:21:14.891337 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:14.891318    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:21:15.041102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.041069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrhw7\" (UniqueName: \"kubernetes.io/projected/ae153060-5bd2-4506-a705-098a63a42564-kube-api-access-jrhw7\") pod \"ae153060-5bd2-4506-a705-098a63a42564\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") "
Jul 29 07:21:15.041274 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.041123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae153060-5bd2-4506-a705-098a63a42564-plugins-config-volume\") pod \"ae153060-5bd2-4506-a705-098a63a42564\" (UID: \"ae153060-5bd2-4506-a705-098a63a42564\") "
Jul 29 07:21:15.041274 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.041252    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7rfg\" (UniqueName: \"kubernetes.io/projected/4c563e29-153b-4bc4-a890-bc77b5bed594-kube-api-access-p7rfg\") pod \"4c563e29-153b-4bc4-a890-bc77b5bed594\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") "
Jul 29 07:21:15.041367 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.041285    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c563e29-153b-4bc4-a890-bc77b5bed594-plugins-config-volume\") pod \"4c563e29-153b-4bc4-a890-bc77b5bed594\" (UID: \"4c563e29-153b-4bc4-a890-bc77b5bed594\") "
Jul 29 07:21:15.041649 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.041522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae153060-5bd2-4506-a705-098a63a42564-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae153060-5bd2-4506-a705-098a63a42564" (UID: "ae153060-5bd2-4506-a705-098a63a42564"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:21:15.041774 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.041664    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c563e29-153b-4bc4-a890-bc77b5bed594-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c563e29-153b-4bc4-a890-bc77b5bed594" (UID: "4c563e29-153b-4bc4-a890-bc77b5bed594"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:21:15.043498 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.043475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c563e29-153b-4bc4-a890-bc77b5bed594-kube-api-access-p7rfg" (OuterVolumeSpecName: "kube-api-access-p7rfg") pod "4c563e29-153b-4bc4-a890-bc77b5bed594" (UID: "4c563e29-153b-4bc4-a890-bc77b5bed594"). InnerVolumeSpecName "kube-api-access-p7rfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:21:15.043586 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.043485    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae153060-5bd2-4506-a705-098a63a42564-kube-api-access-jrhw7" (OuterVolumeSpecName: "kube-api-access-jrhw7") pod "ae153060-5bd2-4506-a705-098a63a42564" (UID: "ae153060-5bd2-4506-a705-098a63a42564"). InnerVolumeSpecName "kube-api-access-jrhw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:21:15.142239 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.142195    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae153060-5bd2-4506-a705-098a63a42564-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:15.142239 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.142234    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7rfg\" (UniqueName: \"kubernetes.io/projected/4c563e29-153b-4bc4-a890-bc77b5bed594-kube-api-access-p7rfg\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:15.142239 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.142244    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c563e29-153b-4bc4-a890-bc77b5bed594-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:15.142239 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.142252    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrhw7\" (UniqueName: \"kubernetes.io/projected/ae153060-5bd2-4506-a705-098a63a42564-kube-api-access-jrhw7\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:15.808963 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.808933    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"
Jul 29 07:21:15.809460 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.808931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp" event={"ID":"4c563e29-153b-4bc4-a890-bc77b5bed594","Type":"ContainerDied","Data":"7180d09cd2db3b21ac90f554669e73287871186a0131add12865b6063f3237ee"}
Jul 29 07:21:15.809460 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.809069    2578 scope.go:117] "RemoveContainer" containerID="3c69b2b7174645571c12e51d31aa6ebe175e4af99829b4573f0e7ad90d258ac5"
Jul 29 07:21:15.810431 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.810375    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"
Jul 29 07:21:15.810431 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.810387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl" event={"ID":"ae153060-5bd2-4506-a705-098a63a42564","Type":"ContainerDied","Data":"835afb6101004f4cd3175084320a9ea385f1222289b0af66df51e4a08b6f49ed"}
Jul 29 07:21:15.820812 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.820790    2578 scope.go:117] "RemoveContainer" containerID="2ccb3bcd05cd725e1d440fa95ed9317b9de9be21e6e72669a60ccde7243b0865"
Jul 29 07:21:15.837935 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.837907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"]
Jul 29 07:21:15.843084 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.843059    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl"]
Jul 29 07:21:15.854005 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.853979    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"]
Jul 29 07:21:15.858835 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:15.858811    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp"]
Jul 29 07:21:16.905511 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:16.905478    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c563e29-153b-4bc4-a890-bc77b5bed594" path="/var/lib/kubelet/pods/4c563e29-153b-4bc4-a890-bc77b5bed594/volumes"
Jul 29 07:21:16.905914 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:16.905861    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae153060-5bd2-4506-a705-098a63a42564" path="/var/lib/kubelet/pods/ae153060-5bd2-4506-a705-098a63a42564/volumes"
Jul 29 07:21:20.135950 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:20.135911    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"]
Jul 29 07:21:24.417245 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:24.417213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:21:35.155917 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.155873    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl" podUID="9bcea859-d20b-498b-b7c1-98308ce859e4" containerName="main" containerID="cri-o://467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a" gracePeriod=45
Jul 29 07:21:35.411793 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.411732    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:21:35.517976 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.517939    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-home\") pod \"9bcea859-d20b-498b-b7c1-98308ce859e4\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") "
Jul 29 07:21:35.517976 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.517976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-model-cache\") pod \"9bcea859-d20b-498b-b7c1-98308ce859e4\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") "
Jul 29 07:21:35.518181 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.517998    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vbs7\" (UniqueName: \"kubernetes.io/projected/9bcea859-d20b-498b-b7c1-98308ce859e4-kube-api-access-9vbs7\") pod \"9bcea859-d20b-498b-b7c1-98308ce859e4\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") "
Jul 29 07:21:35.518181 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-dshm\") pod \"9bcea859-d20b-498b-b7c1-98308ce859e4\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") "
Jul 29 07:21:35.518181 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518072    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-tmp-dir\") pod \"9bcea859-d20b-498b-b7c1-98308ce859e4\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") "
Jul 29 07:21:35.518181 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518111    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcea859-d20b-498b-b7c1-98308ce859e4-tls-certs\") pod \"9bcea859-d20b-498b-b7c1-98308ce859e4\" (UID: \"9bcea859-d20b-498b-b7c1-98308ce859e4\") "
Jul 29 07:21:35.518458 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518191    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-home" (OuterVolumeSpecName: "home") pod "9bcea859-d20b-498b-b7c1-98308ce859e4" (UID: "9bcea859-d20b-498b-b7c1-98308ce859e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:35.518458 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518234    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "9bcea859-d20b-498b-b7c1-98308ce859e4" (UID: "9bcea859-d20b-498b-b7c1-98308ce859e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:35.518458 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9bcea859-d20b-498b-b7c1-98308ce859e4" (UID: "9bcea859-d20b-498b-b7c1-98308ce859e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:35.518458 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518451    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-home\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:35.518644 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.518469    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-model-cache\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:35.520418 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.520394    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcea859-d20b-498b-b7c1-98308ce859e4-kube-api-access-9vbs7" (OuterVolumeSpecName: "kube-api-access-9vbs7") pod "9bcea859-d20b-498b-b7c1-98308ce859e4" (UID: "9bcea859-d20b-498b-b7c1-98308ce859e4"). InnerVolumeSpecName "kube-api-access-9vbs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:21:35.520418 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.520407    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-dshm" (OuterVolumeSpecName: "dshm") pod "9bcea859-d20b-498b-b7c1-98308ce859e4" (UID: "9bcea859-d20b-498b-b7c1-98308ce859e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 07:21:35.520559 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.520484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcea859-d20b-498b-b7c1-98308ce859e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9bcea859-d20b-498b-b7c1-98308ce859e4" (UID: "9bcea859-d20b-498b-b7c1-98308ce859e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 07:21:35.619799 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.619754    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bcea859-d20b-498b-b7c1-98308ce859e4-tls-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:35.619799 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.619795    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vbs7\" (UniqueName: \"kubernetes.io/projected/9bcea859-d20b-498b-b7c1-98308ce859e4-kube-api-access-9vbs7\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:35.619799 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.619807    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-dshm\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:35.619799 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.619815    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bcea859-d20b-498b-b7c1-98308ce859e4-tmp-dir\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:21:35.924749 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.924701    2578 generic.go:356] "Generic (PLEG): container finished" podID="9bcea859-d20b-498b-b7c1-98308ce859e4" containerID="467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a" exitCode=0
Jul 29 07:21:35.924971 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.924763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"
Jul 29 07:21:35.924971 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.924806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl" event={"ID":"9bcea859-d20b-498b-b7c1-98308ce859e4","Type":"ContainerDied","Data":"467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a"}
Jul 29 07:21:35.924971 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.924851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl" event={"ID":"9bcea859-d20b-498b-b7c1-98308ce859e4","Type":"ContainerDied","Data":"a49c9ac5f460836dfad388ef6b70777f97ebcbdf5a15f10effb9483a3f2473fa"}
Jul 29 07:21:35.924971 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.924876    2578 scope.go:117] "RemoveContainer" containerID="467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a"
Jul 29 07:21:35.934809 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.934793    2578 scope.go:117] "RemoveContainer" containerID="467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a"
Jul 29 07:21:35.935069 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:21:35.935050    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a\": container with ID starting with 467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a not found: ID does not exist" containerID="467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a"
Jul 29 07:21:35.935120 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.935078    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a"} err="failed to get container status \"467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a\": rpc error: code = NotFound desc = could not find container \"467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a\": container with ID starting with 467be482367597f2a818bdffc72f3131274ba358c8d72d3eba7721a0debed96a not found: ID does not exist"
Jul 29 07:21:35.946216 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.946192    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"]
Jul 29 07:21:35.950171 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:35.950146    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-aab086/ipp-route-aab086-kserve-66b46f9-kkscl"]
Jul 29 07:21:36.905423 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:21:36.905381    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bcea859-d20b-498b-b7c1-98308ce859e4" path="/var/lib/kubelet/pods/9bcea859-d20b-498b-b7c1-98308ce859e4/volumes"
Jul 29 07:22:03.576685 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.576646    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"]
Jul 29 07:22:03.577131 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577121    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c563e29-153b-4bc4-a890-bc77b5bed594" containerName="payload-processing"
Jul 29 07:22:03.577178 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577136    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c563e29-153b-4bc4-a890-bc77b5bed594" containerName="payload-processing"
Jul 29 07:22:03.577178 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577144    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcea859-d20b-498b-b7c1-98308ce859e4" containerName="main"
Jul 29 07:22:03.577178 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577149    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcea859-d20b-498b-b7c1-98308ce859e4" containerName="main"
Jul 29 07:22:03.577178 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577161    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae153060-5bd2-4506-a705-098a63a42564" containerName="payload-pre-processing"
Jul 29 07:22:03.577178 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577167    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae153060-5bd2-4506-a705-098a63a42564" containerName="payload-pre-processing"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577182    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc82f75-07c4-4341-beed-798778eabf91" containerName="payload-pre-processing"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577187    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc82f75-07c4-4341-beed-798778eabf91" containerName="payload-pre-processing"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577194    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4693e97-d1b4-47e2-89a2-06cb43cc5efa" containerName="revoke-keys"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577201    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4693e97-d1b4-47e2-89a2-06cb43cc5efa" containerName="revoke-keys"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577209    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577214    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577220    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577225    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577278    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae153060-5bd2-4506-a705-098a63a42564" containerName="payload-pre-processing"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577286    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577292    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4693e97-d1b4-47e2-89a2-06cb43cc5efa" containerName="revoke-keys"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577297    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc82f75-07c4-4341-beed-798778eabf91" containerName="payload-pre-processing"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577302    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c563e29-153b-4bc4-a890-bc77b5bed594" containerName="payload-processing"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577307    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30f38f8-3013-4ef5-967b-ff1cbad0981f" containerName="istio-proxy"
Jul 29 07:22:03.577338 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.577313    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bcea859-d20b-498b-b7c1-98308ce859e4" containerName="main"
Jul 29 07:22:03.580415 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.580397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:03.583024 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.582991    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:22:03.583164 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.583070    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:22:03.588869 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.588694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"]
Jul 29 07:22:03.676554 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.676510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20ff5fd-2b68-43dd-84fb-4a840f1422b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh\" (UID: \"f20ff5fd-2b68-43dd-84fb-4a840f1422b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:03.778091 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.778053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20ff5fd-2b68-43dd-84fb-4a840f1422b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh\" (UID: \"f20ff5fd-2b68-43dd-84fb-4a840f1422b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:03.778645 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.778625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20ff5fd-2b68-43dd-84fb-4a840f1422b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh\" (UID: \"f20ff5fd-2b68-43dd-84fb-4a840f1422b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:03.892978 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:03.892943    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:04.039323 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:04.039295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"]
Jul 29 07:22:04.040832 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:22:04.040800    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20ff5fd_2b68_43dd_84fb_4a840f1422b7.slice/crio-1c21492ef8bec323ce10095677df93856de752ab8acd53ce218090b40843bee7 WatchSource:0}: Error finding container 1c21492ef8bec323ce10095677df93856de752ab8acd53ce218090b40843bee7: Status 404 returned error can't find the container with id 1c21492ef8bec323ce10095677df93856de752ab8acd53ce218090b40843bee7
Jul 29 07:22:04.084916 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:04.084887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh" event={"ID":"f20ff5fd-2b68-43dd-84fb-4a840f1422b7","Type":"ContainerStarted","Data":"1c21492ef8bec323ce10095677df93856de752ab8acd53ce218090b40843bee7"}
Jul 29 07:22:05.092820 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:05.092782    2578 generic.go:356] "Generic (PLEG): container finished" podID="f20ff5fd-2b68-43dd-84fb-4a840f1422b7" containerID="2b533f221204adab64c7b4756e5241136e56e87dd3a080e61134f18c1f668fa6" exitCode=0
Jul 29 07:22:05.093211 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:05.092867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh" event={"ID":"f20ff5fd-2b68-43dd-84fb-4a840f1422b7","Type":"ContainerDied","Data":"2b533f221204adab64c7b4756e5241136e56e87dd3a080e61134f18c1f668fa6"}
Jul 29 07:22:06.241742 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:06.241698    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:06.303962 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:06.303921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20ff5fd-2b68-43dd-84fb-4a840f1422b7-maas-api-service-ca\") pod \"f20ff5fd-2b68-43dd-84fb-4a840f1422b7\" (UID: \"f20ff5fd-2b68-43dd-84fb-4a840f1422b7\") "
Jul 29 07:22:06.304298 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:06.304275    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f20ff5fd-2b68-43dd-84fb-4a840f1422b7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f20ff5fd-2b68-43dd-84fb-4a840f1422b7" (UID: "f20ff5fd-2b68-43dd-84fb-4a840f1422b7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:22:06.405384 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:06.405347    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20ff5fd-2b68-43dd-84fb-4a840f1422b7-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:07.105620 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:07.105592    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"
Jul 29 07:22:07.105620 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:07.105604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh" event={"ID":"f20ff5fd-2b68-43dd-84fb-4a840f1422b7","Type":"ContainerDied","Data":"1c21492ef8bec323ce10095677df93856de752ab8acd53ce218090b40843bee7"}
Jul 29 07:22:07.105853 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:07.105648    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c21492ef8bec323ce10095677df93856de752ab8acd53ce218090b40843bee7"
Jul 29 07:22:09.101384 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:09.101337    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"]
Jul 29 07:22:09.105081 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:09.105044    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-04c3b9-zlnbh"]
Jul 29 07:22:10.904988 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:10.904956    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f20ff5fd-2b68-43dd-84fb-4a840f1422b7" path="/var/lib/kubelet/pods/f20ff5fd-2b68-43dd-84fb-4a840f1422b7/volumes"
Jul 29 07:22:12.624969 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:12.624933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:22:16.302118 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.302083    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"]
Jul 29 07:22:16.302551 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.302538    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20ff5fd-2b68-43dd-84fb-4a840f1422b7" containerName="revoke-keys"
Jul 29 07:22:16.302599 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.302553    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20ff5fd-2b68-43dd-84fb-4a840f1422b7" containerName="revoke-keys"
Jul 29 07:22:16.302631 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.302619    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20ff5fd-2b68-43dd-84fb-4a840f1422b7" containerName="revoke-keys"
Jul 29 07:22:16.306932 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.306912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:16.309857 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.309830    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bj47g\""
Jul 29 07:22:16.309857 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.309830    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 07:22:16.314226 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.314197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"]
Jul 29 07:22:16.395159 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.395121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv\" (UID: \"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:16.496411 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.496368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv\" (UID: \"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:16.497041 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.497023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv\" (UID: \"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:16.619254 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.619218    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:16.764583 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:16.764537    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"]
Jul 29 07:22:16.767829 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:22:16.767797    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b5b82d_8343_4d8b_b5aa_c2b9f14e0e11.slice/crio-cdc3f5b530d1246dfd41deff0248eb8af136e6c1a2f0aa17b181ea5277fd9040 WatchSource:0}: Error finding container cdc3f5b530d1246dfd41deff0248eb8af136e6c1a2f0aa17b181ea5277fd9040: Status 404 returned error can't find the container with id cdc3f5b530d1246dfd41deff0248eb8af136e6c1a2f0aa17b181ea5277fd9040
Jul 29 07:22:17.170511 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:17.170476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv" event={"ID":"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11","Type":"ContainerStarted","Data":"4f6fd10a88b940a7e9626efa87e5c8e2fc8ac86bedf878db889cefb6d8530d51"}
Jul 29 07:22:17.170678 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:17.170528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv" event={"ID":"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11","Type":"ContainerStarted","Data":"cdc3f5b530d1246dfd41deff0248eb8af136e6c1a2f0aa17b181ea5277fd9040"}
Jul 29 07:22:17.189283 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:17.189221    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv" podStartSLOduration=1.189201351 podStartE2EDuration="1.189201351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:22:17.185348953 +0000 UTC m=+3578.820940743" watchObservedRunningTime="2026-07-29 07:22:17.189201351 +0000 UTC m=+3578.824793144"
Jul 29 07:22:18.177281 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:18.177249    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11" containerID="4f6fd10a88b940a7e9626efa87e5c8e2fc8ac86bedf878db889cefb6d8530d51" exitCode=0
Jul 29 07:22:18.177727 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:18.177321    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv" event={"ID":"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11","Type":"ContainerDied","Data":"4f6fd10a88b940a7e9626efa87e5c8e2fc8ac86bedf878db889cefb6d8530d51"}
Jul 29 07:22:19.334353 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:19.334325    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:19.420571 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:19.420535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11-maas-api-service-ca\") pod \"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11\" (UID: \"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11\") "
Jul 29 07:22:19.420952 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:19.420928    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11" (UID: "e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:22:19.522117 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:19.522031    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11-maas-api-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:20.191269 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.191234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv" event={"ID":"e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11","Type":"ContainerDied","Data":"cdc3f5b530d1246dfd41deff0248eb8af136e6c1a2f0aa17b181ea5277fd9040"}
Jul 29 07:22:20.191269 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.191267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"
Jul 29 07:22:20.191480 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.191284    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdc3f5b530d1246dfd41deff0248eb8af136e6c1a2f0aa17b181ea5277fd9040"
Jul 29 07:22:20.865218 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.865181    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"]
Jul 29 07:22:20.867664 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.867636    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-50e693-29755155-fww8d"]
Jul 29 07:22:20.905008 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.904971    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7c6352-e614-4cf8-9a69-a2e48c02ac3e" path="/var/lib/kubelet/pods/ba7c6352-e614-4cf8-9a69-a2e48c02ac3e/volumes"
Jul 29 07:22:20.956640 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.956610    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"]
Jul 29 07:22:20.956856 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:20.956831    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh" podUID="de28827f-b50a-4fa8-95d7-922137f6869f" containerName="payload-processing" containerID="cri-o://c4b34f0feae6adca1642b939ac5fadd9bd30f39b7e5f6a2c05e8c8fbe90bf5b2" gracePeriod=30
Jul 29 07:22:21.161171 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.161130    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"]
Jul 29 07:22:21.165127 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.165066    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-50e693-x6zgv"]
Jul 29 07:22:21.199917 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.199882    2578 generic.go:356] "Generic (PLEG): container finished" podID="de28827f-b50a-4fa8-95d7-922137f6869f" containerID="c4b34f0feae6adca1642b939ac5fadd9bd30f39b7e5f6a2c05e8c8fbe90bf5b2" exitCode=0
Jul 29 07:22:21.200082 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.199950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh" event={"ID":"de28827f-b50a-4fa8-95d7-922137f6869f","Type":"ContainerDied","Data":"c4b34f0feae6adca1642b939ac5fadd9bd30f39b7e5f6a2c05e8c8fbe90bf5b2"}
Jul 29 07:22:21.233305 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.233283    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:22:21.337133 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.337094    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n45zp\" (UniqueName: \"kubernetes.io/projected/de28827f-b50a-4fa8-95d7-922137f6869f-kube-api-access-n45zp\") pod \"de28827f-b50a-4fa8-95d7-922137f6869f\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") "
Jul 29 07:22:21.337133 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.337134    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de28827f-b50a-4fa8-95d7-922137f6869f-plugins-config-volume\") pod \"de28827f-b50a-4fa8-95d7-922137f6869f\" (UID: \"de28827f-b50a-4fa8-95d7-922137f6869f\") "
Jul 29 07:22:21.337595 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.337572    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de28827f-b50a-4fa8-95d7-922137f6869f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de28827f-b50a-4fa8-95d7-922137f6869f" (UID: "de28827f-b50a-4fa8-95d7-922137f6869f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:22:21.339832 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.339808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de28827f-b50a-4fa8-95d7-922137f6869f-kube-api-access-n45zp" (OuterVolumeSpecName: "kube-api-access-n45zp") pod "de28827f-b50a-4fa8-95d7-922137f6869f" (UID: "de28827f-b50a-4fa8-95d7-922137f6869f"). InnerVolumeSpecName "kube-api-access-n45zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:22:21.438033 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.437945    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n45zp\" (UniqueName: \"kubernetes.io/projected/de28827f-b50a-4fa8-95d7-922137f6869f-kube-api-access-n45zp\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:21.438033 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:21.437976    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de28827f-b50a-4fa8-95d7-922137f6869f-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:22.207487 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.207458    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"
Jul 29 07:22:22.207966 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.207485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh" event={"ID":"de28827f-b50a-4fa8-95d7-922137f6869f","Type":"ContainerDied","Data":"6d1e718d2a86a43c9bdc07bf8280310562eca1d2aaceb3217f3f83353f76b35b"}
Jul 29 07:22:22.207966 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.207543    2578 scope.go:117] "RemoveContainer" containerID="c4b34f0feae6adca1642b939ac5fadd9bd30f39b7e5f6a2c05e8c8fbe90bf5b2"
Jul 29 07:22:22.231650 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.231622    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"]
Jul 29 07:22:22.237794 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.237766    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh"]
Jul 29 07:22:22.904221 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.904189    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de28827f-b50a-4fa8-95d7-922137f6869f" path="/var/lib/kubelet/pods/de28827f-b50a-4fa8-95d7-922137f6869f/volumes"
Jul 29 07:22:22.904517 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:22.904505    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11" path="/var/lib/kubelet/pods/e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11/volumes"
Jul 29 07:22:24.103697 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:24.103662    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:22:38.697137 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.697089    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"]
Jul 29 07:22:38.697830 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.697361    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp" podUID="158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" containerName="payload-processing" containerID="cri-o://4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed" gracePeriod=30
Jul 29 07:22:38.703185 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.703156    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"]
Jul 29 07:22:38.703429 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.703386    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p" podUID="20679830-0c4c-4c27-b963-c750b7583726" containerName="payload-pre-processing" containerID="cri-o://36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae" gracePeriod=30
Jul 29 07:22:38.969922 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.969893    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:22:38.998783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.997930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-plugins-config-volume\") pod \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") "
Jul 29 07:22:38.998783 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.998014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-kube-api-access-cjchq\") pod \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\" (UID: \"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa\") "
Jul 29 07:22:38.999344 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:38.999157    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" (UID: "158c0a08-6b25-4dd7-a4ed-a9e55956b3fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:22:39.002010 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.001984    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-kube-api-access-cjchq" (OuterVolumeSpecName: "kube-api-access-cjchq") pod "158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" (UID: "158c0a08-6b25-4dd7-a4ed-a9e55956b3fa"). InnerVolumeSpecName "kube-api-access-cjchq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:22:39.017543 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.017517    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:22:39.098987 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.098946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20679830-0c4c-4c27-b963-c750b7583726-plugins-config-volume\") pod \"20679830-0c4c-4c27-b963-c750b7583726\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") "
Jul 29 07:22:39.099145 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.099001    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bd8r\" (UniqueName: \"kubernetes.io/projected/20679830-0c4c-4c27-b963-c750b7583726-kube-api-access-7bd8r\") pod \"20679830-0c4c-4c27-b963-c750b7583726\" (UID: \"20679830-0c4c-4c27-b963-c750b7583726\") "
Jul 29 07:22:39.099226 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.099209    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:39.099275 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.099228    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa-kube-api-access-cjchq\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:39.099320 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.099297    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20679830-0c4c-4c27-b963-c750b7583726-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20679830-0c4c-4c27-b963-c750b7583726" (UID: "20679830-0c4c-4c27-b963-c750b7583726"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 07:22:39.101124 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.101101    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20679830-0c4c-4c27-b963-c750b7583726-kube-api-access-7bd8r" (OuterVolumeSpecName: "kube-api-access-7bd8r") pod "20679830-0c4c-4c27-b963-c750b7583726" (UID: "20679830-0c4c-4c27-b963-c750b7583726"). InnerVolumeSpecName "kube-api-access-7bd8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 07:22:39.199684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.199605    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20679830-0c4c-4c27-b963-c750b7583726-plugins-config-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:39.199684 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.199634    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bd8r\" (UniqueName: \"kubernetes.io/projected/20679830-0c4c-4c27-b963-c750b7583726-kube-api-access-7bd8r\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\""
Jul 29 07:22:39.203046 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.203025    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:22:39.207522 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.207499    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:22:39.222820 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.222798    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:22:39.227176 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.227156    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-br2sf_e66ffe76-f05d-46ea-a4a9-77aaa6efd621/ovn-acl-logging/0.log"
Jul 29 07:22:39.309353 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.309315    2578 generic.go:356] "Generic (PLEG): container finished" podID="20679830-0c4c-4c27-b963-c750b7583726" containerID="36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae" exitCode=0
Jul 29 07:22:39.309554 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.309375    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"
Jul 29 07:22:39.309554 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.309401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p" event={"ID":"20679830-0c4c-4c27-b963-c750b7583726","Type":"ContainerDied","Data":"36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae"}
Jul 29 07:22:39.309554 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.309483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p" event={"ID":"20679830-0c4c-4c27-b963-c750b7583726","Type":"ContainerDied","Data":"4e7a2a43dba2db836a7f2f031690a69d19cb858e5f696a12e83a4a6e40edfd80"}
Jul 29 07:22:39.309554 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.309512    2578 scope.go:117] "RemoveContainer" containerID="36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae"
Jul 29 07:22:39.311004 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.310982    2578 generic.go:356] "Generic (PLEG): container finished" podID="158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" containerID="4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed" exitCode=0
Jul 29 07:22:39.311102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.311041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp" event={"ID":"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa","Type":"ContainerDied","Data":"4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed"}
Jul 29 07:22:39.311102 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.311084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp" event={"ID":"158c0a08-6b25-4dd7-a4ed-a9e55956b3fa","Type":"ContainerDied","Data":"cba2afeae0ec8baeb1e144af84c2b14a1daddd508876ad1474297bd35c553971"}
Jul 29 07:22:39.311214 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.311199    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"
Jul 29 07:22:39.320667 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.320556    2578 scope.go:117] "RemoveContainer" containerID="36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae"
Jul 29 07:22:39.320945 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:22:39.320924    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae\": container with ID starting with 36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae not found: ID does not exist" containerID="36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae"
Jul 29 07:22:39.321031 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.320953    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae"} err="failed to get container status \"36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae\": rpc error: code = NotFound desc = could not find container \"36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae\": container with ID starting with 36935273eca8a42a2833e51b7115386637eace87962d620c2ab18ac4b8c403ae not found: ID does not exist"
Jul 29 07:22:39.321031 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.320973    2578 scope.go:117] "RemoveContainer" containerID="4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed"
Jul 29 07:22:39.329089 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.329074    2578 scope.go:117] "RemoveContainer" containerID="4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed"
Jul 29 07:22:39.329329 ip-10-0-133-7 kubenswrapper[2578]: E0729 07:22:39.329312    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed\": container with ID starting with 4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed not found: ID does not exist" containerID="4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed"
Jul 29 07:22:39.329399 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.329334    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed"} err="failed to get container status \"4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed\": rpc error: code = NotFound desc = could not find container \"4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed\": container with ID starting with 4d0d8587fdf116cbe14733d13ed442727ab77c18751961335ea176eb7eceb3ed not found: ID does not exist"
Jul 29 07:22:39.333787 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.333765    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"]
Jul 29 07:22:39.337486 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.337466    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p"]
Jul 29 07:22:39.352724 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.352670    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"]
Jul 29 07:22:39.359221 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.359195    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp"]
Jul 29 07:22:39.512669 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:39.512590    2578 scope.go:117] "RemoveContainer" containerID="b9db9e69dd6b26c886c77c6c64cae3ab344ccc13fb0749541c1b3e45d6a52594"
Jul 29 07:22:40.904994 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:40.904963    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" path="/var/lib/kubelet/pods/158c0a08-6b25-4dd7-a4ed-a9e55956b3fa/volumes"
Jul 29 07:22:40.905369 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:40.905320    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20679830-0c4c-4c27-b963-c750b7583726" path="/var/lib/kubelet/pods/20679830-0c4c-4c27-b963-c750b7583726/volumes"
Jul 29 07:22:41.520261 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:41.520224    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qkztl"]
Jul 29 07:22:52.374894 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:52.374867    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jzx29_da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1/manager/0.log"
Jul 29 07:22:52.500268 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:52.500221    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fzvcc_b3a0fc9d-54ac-42a6-a165-9bab5a714b38/manager/0.log"
Jul 29 07:22:52.753128 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:52.753050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-czmfw_95757fa3-dbe0-4bdf-8076-083256da481b/server/0.log"
Jul 29 07:22:52.869032 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:52.869003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4wcw4_460b74e1-0c98-4546-8cff-793cdf55a4f7/manager/0.log"
Jul 29 07:22:53.112561 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:53.112537    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6c7945d7-rm6gh_e72efaa4-3347-4e56-873d-024991ad9fd6/copy-manifests/0.log"
Jul 29 07:22:53.119680 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:53.119658    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6c7945d7-rm6gh_e72efaa4-3347-4e56-873d-024991ad9fd6/manager/0.log"
Jul 29 07:22:53.971638 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:53.971612    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755155-qmcqt_82e27895-5beb-416c-a5b3-d3ab30e62342/cleanup/0.log"
Jul 29 07:22:54.834145 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:54.834073    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr_f0bc4446-7c8d-4e04-80dd-a643c42d6bfe/extract/0.log"
Jul 29 07:22:54.842536 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:54.842508    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr_f0bc4446-7c8d-4e04-80dd-a643c42d6bfe/util/0.log"
Jul 29 07:22:54.849464 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:54.849445    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr_f0bc4446-7c8d-4e04-80dd-a643c42d6bfe/pull/0.log"
Jul 29 07:22:54.955629 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:54.955604    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh_20183204-0d3c-4d21-bdb8-fade07f7d288/util/0.log"
Jul 29 07:22:54.963379 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:54.963356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh_20183204-0d3c-4d21-bdb8-fade07f7d288/pull/0.log"
Jul 29 07:22:54.969510 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:54.969491    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh_20183204-0d3c-4d21-bdb8-fade07f7d288/extract/0.log"
Jul 29 07:22:55.079266 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.079242    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb_611af5bb-899b-46ed-89d0-f9c39d08c173/util/0.log"
Jul 29 07:22:55.086576 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.086518    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb_611af5bb-899b-46ed-89d0-f9c39d08c173/pull/0.log"
Jul 29 07:22:55.092372 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.092358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb_611af5bb-899b-46ed-89d0-f9c39d08c173/extract/0.log"
Jul 29 07:22:55.204569 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.204540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg_fe66cc5e-8f69-43eb-a878-08a1626a0ce3/util/0.log"
Jul 29 07:22:55.210540 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.210515    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg_fe66cc5e-8f69-43eb-a878-08a1626a0ce3/pull/0.log"
Jul 29 07:22:55.216174 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.216159    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg_fe66cc5e-8f69-43eb-a878-08a1626a0ce3/extract/0.log"
Jul 29 07:22:55.554065 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.554038    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tz84h_e11fc148-5d3a-47d8-89a6-852f40854fc6/manager/0.log"
Jul 29 07:22:55.910826 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:55.910800    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hf977_a1c0b608-ff01-4b55-8d7c-b3963130cffa/manager/0.log"
Jul 29 07:22:56.021616 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:56.021589    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qkztl_04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c/limitador/0.log"
Jul 29 07:22:56.616594 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:56.616562    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hz7x2_2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9/discovery/0.log"
Jul 29 07:22:56.840848 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:56.840822    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c857974d4-r6zml_19955dba-22ce-4b39-84e0-c92b48a5ca94/kube-auth-proxy/0.log"
Jul 29 07:22:57.309182 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:57.309158    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cf88d7cdf-w5kz2_ecc4b76d-788a-4a4a-87cd-4dacab9c514f/router/0.log"
Jul 29 07:22:57.872390 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:22:57.872364    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-br8m8_37871dbb-3580-4a22-b65b-3e2c874a04a2/main/0.log"
Jul 29 07:23:06.933522 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:06.933488    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m7dhw_64ae52ce-78bf-414a-b277-c410b351ac9d/global-pull-secret-syncer/0.log"
Jul 29 07:23:07.147038 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:07.147005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rgsdl_f55d408d-4dd9-48ef-a4c4-321ea164bb65/konnectivity-agent/0.log"
Jul 29 07:23:07.364452 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:07.364421    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-7.ec2.internal_549091cca5f0a3b021a686609b790c31/haproxy/0.log"
Jul 29 07:23:11.757117 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:11.757091    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr_f0bc4446-7c8d-4e04-80dd-a643c42d6bfe/extract/0.log"
Jul 29 07:23:11.792974 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:11.792943    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr_f0bc4446-7c8d-4e04-80dd-a643c42d6bfe/util/0.log"
Jul 29 07:23:11.928393 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:11.928361    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbrvr_f0bc4446-7c8d-4e04-80dd-a643c42d6bfe/pull/0.log"
Jul 29 07:23:11.994529 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:11.994503    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh_20183204-0d3c-4d21-bdb8-fade07f7d288/extract/0.log"
Jul 29 07:23:12.052401 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.052324    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh_20183204-0d3c-4d21-bdb8-fade07f7d288/util/0.log"
Jul 29 07:23:12.117056 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.117029    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mz2fh_20183204-0d3c-4d21-bdb8-fade07f7d288/pull/0.log"
Jul 29 07:23:12.181819 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.181796    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb_611af5bb-899b-46ed-89d0-f9c39d08c173/extract/0.log"
Jul 29 07:23:12.229378 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.229347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb_611af5bb-899b-46ed-89d0-f9c39d08c173/util/0.log"
Jul 29 07:23:12.285501 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.285471    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m92rb_611af5bb-899b-46ed-89d0-f9c39d08c173/pull/0.log"
Jul 29 07:23:12.350037 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.349940    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg_fe66cc5e-8f69-43eb-a878-08a1626a0ce3/extract/0.log"
Jul 29 07:23:12.397380 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.397354    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg_fe66cc5e-8f69-43eb-a878-08a1626a0ce3/util/0.log"
Jul 29 07:23:12.450568 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.450538    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15glpg_fe66cc5e-8f69-43eb-a878-08a1626a0ce3/pull/0.log"
Jul 29 07:23:12.898093 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:12.898060    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tz84h_e11fc148-5d3a-47d8-89a6-852f40854fc6/manager/0.log"
Jul 29 07:23:13.286651 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:13.286562    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hf977_a1c0b608-ff01-4b55-8d7c-b3963130cffa/manager/0.log"
Jul 29 07:23:13.360065 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:13.360036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qkztl_04d4dcbc-c6fe-40a7-8ae3-e80fb9cd4e1c/limitador/0.log"
Jul 29 07:23:15.741614 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:15.741587    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-7l6z2_0e9fe44d-eed8-49c5-958d-648ff7030ed5/monitoring-plugin/0.log"
Jul 29 07:23:16.081977 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.081902    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ch5rp_e9b776ff-9c5c-441d-986e-dc10ec51ae0b/node-exporter/0.log"
Jul 29 07:23:16.123540 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.123515    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ch5rp_e9b776ff-9c5c-441d-986e-dc10ec51ae0b/kube-rbac-proxy/0.log"
Jul 29 07:23:16.172593 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.172563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ch5rp_e9b776ff-9c5c-441d-986e-dc10ec51ae0b/init-textfile/0.log"
Jul 29 07:23:16.233099 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233063    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"]
Jul 29 07:23:16.233453 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233439    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de28827f-b50a-4fa8-95d7-922137f6869f" containerName="payload-processing"
Jul 29 07:23:16.233499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233454    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="de28827f-b50a-4fa8-95d7-922137f6869f" containerName="payload-processing"
Jul 29 07:23:16.233499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233470    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20679830-0c4c-4c27-b963-c750b7583726" containerName="payload-pre-processing"
Jul 29 07:23:16.233499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233476    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20679830-0c4c-4c27-b963-c750b7583726" containerName="payload-pre-processing"
Jul 29 07:23:16.233499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233482    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11" containerName="revoke-keys"
Jul 29 07:23:16.233499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233489    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11" containerName="revoke-keys"
Jul 29 07:23:16.233499 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233500    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" containerName="payload-processing"
Jul 29 07:23:16.233688 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233505    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" containerName="payload-processing"
Jul 29 07:23:16.233688 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233571    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b5b82d-8343-4d8b-b5aa-c2b9f14e0e11" containerName="revoke-keys"
Jul 29 07:23:16.233688 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233578    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="de28827f-b50a-4fa8-95d7-922137f6869f" containerName="payload-processing"
Jul 29 07:23:16.233688 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233584    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="158c0a08-6b25-4dd7-a4ed-a9e55956b3fa" containerName="payload-processing"
Jul 29 07:23:16.233688 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.233592    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="20679830-0c4c-4c27-b963-c750b7583726" containerName="payload-pre-processing"
Jul 29 07:23:16.236516 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.236501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.239918 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.239897    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rtf28\"/\"default-dockercfg-zbqqp\""
Jul 29 07:23:16.240238 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.240222    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rtf28\"/\"openshift-service-ca.crt\""
Jul 29 07:23:16.240859 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.240844    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rtf28\"/\"kube-root-ca.crt\""
Jul 29 07:23:16.258966 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.258937    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"]
Jul 29 07:23:16.319098 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.319063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dth8\" (UniqueName: \"kubernetes.io/projected/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-kube-api-access-8dth8\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.319271 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.319107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-sys\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.319271 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.319128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-lib-modules\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.319271 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.319228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-proc\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.319271 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.319256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-podres\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420497 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dth8\" (UniqueName: \"kubernetes.io/projected/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-kube-api-access-8dth8\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420703 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-sys\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420703 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-sys\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420703 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-lib-modules\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-proc\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-podres\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-lib-modules\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-proc\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.420908 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.420858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-podres\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.429891 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.429868    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dth8\" (UniqueName: \"kubernetes.io/projected/9a117e99-6dbb-46ed-bfb0-3abaa0a2727f-kube-api-access-8dth8\") pod \"perf-node-gather-daemonset-m4rp5\" (UID: \"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f\") " pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.546599 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.546568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:16.694564 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.694530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"]
Jul 29 07:23:16.696432 ip-10-0-133-7 kubenswrapper[2578]: W0729 07:23:16.696404    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a117e99_6dbb_46ed_bfb0_3abaa0a2727f.slice/crio-d9b91fde8b56ba8f80cf3ffa502278bce598de93aef44063b6aa48ff2162af03 WatchSource:0}: Error finding container d9b91fde8b56ba8f80cf3ffa502278bce598de93aef44063b6aa48ff2162af03: Status 404 returned error can't find the container with id d9b91fde8b56ba8f80cf3ffa502278bce598de93aef44063b6aa48ff2162af03
Jul 29 07:23:16.881431 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.881394    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7889c996bb-xnblk_b0f092f9-debb-405f-9691-5b9da233fb94/thanos-query/0.log"
Jul 29 07:23:16.909259 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.909231    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7889c996bb-xnblk_b0f092f9-debb-405f-9691-5b9da233fb94/kube-rbac-proxy-web/0.log"
Jul 29 07:23:16.938075 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.938049    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7889c996bb-xnblk_b0f092f9-debb-405f-9691-5b9da233fb94/kube-rbac-proxy/0.log"
Jul 29 07:23:16.968401 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.968325    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7889c996bb-xnblk_b0f092f9-debb-405f-9691-5b9da233fb94/prom-label-proxy/0.log"
Jul 29 07:23:16.998408 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:16.998384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7889c996bb-xnblk_b0f092f9-debb-405f-9691-5b9da233fb94/kube-rbac-proxy-rules/0.log"
Jul 29 07:23:17.038207 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:17.038184    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7889c996bb-xnblk_b0f092f9-debb-405f-9691-5b9da233fb94/kube-rbac-proxy-metrics/0.log"
Jul 29 07:23:17.531443 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:17.531403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5" event={"ID":"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f","Type":"ContainerStarted","Data":"f0516d5818cbe5ac59ec31d2e0528050b05edbf1851867dfba83ea479e3ab25f"}
Jul 29 07:23:17.531635 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:17.531488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5" event={"ID":"9a117e99-6dbb-46ed-bfb0-3abaa0a2727f","Type":"ContainerStarted","Data":"d9b91fde8b56ba8f80cf3ffa502278bce598de93aef44063b6aa48ff2162af03"}
Jul 29 07:23:17.531635 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:17.531513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:17.559308 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:17.559265    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5" podStartSLOduration=1.559248878 podStartE2EDuration="1.559248878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:23:17.556439098 +0000 UTC m=+3639.192030889" watchObservedRunningTime="2026-07-29 07:23:17.559248878 +0000 UTC m=+3639.194840668"
Jul 29 07:23:18.851230 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:18.851204    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/2.log"
Jul 29 07:23:18.855407 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:18.855380    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-d8mbm_ac690d0e-c824-4b8b-9f44-f4f69a1eef7f/console-operator/3.log"
Jul 29 07:23:19.353208 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:19.353177    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f49b66c86-8tjqn_4792dcc7-d017-4417-aed5-9a9d4e037992/console/0.log"
Jul 29 07:23:19.416956 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:19.416927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-qkct9_78585927-f55f-4a45-a243-d6372b3c62ac/download-server/0.log"
Jul 29 07:23:20.031157 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:20.031130    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-g82x6_5df96dad-0811-4955-81e8-f0a855e3bc9a/volume-data-source-validator/0.log"
Jul 29 07:23:21.116417 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:21.116385    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rxmn_85cfbced-8f75-4d1a-b9eb-601c8b10140d/dns/0.log"
Jul 29 07:23:21.147034 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:21.147005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rxmn_85cfbced-8f75-4d1a-b9eb-601c8b10140d/kube-rbac-proxy/0.log"
Jul 29 07:23:21.375085 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:21.375004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rtlff_eb6a007a-7076-40ca-9e91-63b8230a6213/dns-node-resolver/0.log"
Jul 29 07:23:22.131224 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:22.131194    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cx94n_84996c51-2a76-484c-8fc3-5eff65bab848/node-ca/0.log"
Jul 29 07:23:23.352357 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:23.352321    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hz7x2_2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9/discovery/0.log"
Jul 29 07:23:23.414574 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:23.414547    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c857974d4-r6zml_19955dba-22ce-4b39-84e0-c92b48a5ca94/kube-auth-proxy/0.log"
Jul 29 07:23:23.549106 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:23.549078    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rtf28/perf-node-gather-daemonset-m4rp5"
Jul 29 07:23:23.630667 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:23.630637    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cf88d7cdf-w5kz2_ecc4b76d-788a-4a4a-87cd-4dacab9c514f/router/0.log"
Jul 29 07:23:24.562638 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:24.562609    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m9nk9_44d59680-97e5-4bb5-afbb-e8f05a4806fa/serve-healthcheck-canary/0.log"
Jul 29 07:23:25.408974 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:25.408948    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t5jmq_92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03/kube-rbac-proxy/0.log"
Jul 29 07:23:25.448883 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:25.448862    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t5jmq_92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03/exporter/0.log"
Jul 29 07:23:25.485424 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:25.485400    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t5jmq_92d2a9d9-eca0-4583-93dd-0fa7f0f6ad03/extractor/0.log"
Jul 29 07:23:27.193340 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:27.193310    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hz7x2_2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9/discovery/0.log"
Jul 29 07:23:27.223546 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:27.223522    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c857974d4-r6zml_19955dba-22ce-4b39-84e0-c92b48a5ca94/kube-auth-proxy/0.log"
Jul 29 07:23:27.377537 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:27.377507    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cf88d7cdf-w5kz2_ecc4b76d-788a-4a4a-87cd-4dacab9c514f/router/0.log"
Jul 29 07:23:28.059992 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.059949    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jzx29_da68fc5d-b32e-4bfe-9ffa-ddf60d674ba1/manager/0.log"
Jul 29 07:23:28.273651 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.273565    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fzvcc_b3a0fc9d-54ac-42a6-a165-9bab5a714b38/manager/0.log"
Jul 29 07:23:28.453607 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.453578    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-czmfw_95757fa3-dbe0-4bdf-8076-083256da481b/server/0.log"
Jul 29 07:23:28.538606 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.538523    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4wcw4_460b74e1-0c98-4546-8cff-793cdf55a4f7/manager/0.log"
Jul 29 07:23:28.664846 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.664815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6c7945d7-rm6gh_e72efaa4-3347-4e56-873d-024991ad9fd6/manager/0.log"
Jul 29 07:23:28.724724 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.724692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d6c7945d7-rm6gh_e72efaa4-3347-4e56-873d-024991ad9fd6/copy-manifests/0.log"
Jul 29 07:23:28.931334 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.931304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-hz7x2_2ce7fbb5-95e3-482b-8c56-7cfeca34ebf9/discovery/0.log"
Jul 29 07:23:28.971159 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:28.971128    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c857974d4-r6zml_19955dba-22ce-4b39-84e0-c92b48a5ca94/kube-auth-proxy/0.log"
Jul 29 07:23:29.160637 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:29.160596    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cf88d7cdf-w5kz2_ecc4b76d-788a-4a4a-87cd-4dacab9c514f/router/0.log"
Jul 29 07:23:30.244878 ip-10-0-133-7 kubenswrapper[2578]: I0729 07:23:30.244847    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8mzd7_ecf79b14-5863-484d-afdd-85ae46955b5e/openshift-lws-operator/0.log"