Jul 24 14:30:05.139453 ip-10-0-140-168 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 14:30:05.139465 ip-10-0-140-168 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 14:30:05.139475 ip-10-0-140-168 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 14:30:05.139891 ip-10-0-140-168 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 14:30:15.301596 ip-10-0-140-168 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 14:30:15.301611 ip-10-0-140-168 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6d70f50535f74b16b2a6e14105c403fc --
Jul 24 14:32:02.553147 ip-10-0-140-168 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 14:32:02.873986 ip-10-0-140-168 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:32:02.873986 ip-10-0-140-168 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 14:32:02.873986 ip-10-0-140-168 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:32:02.873986 ip-10-0-140-168 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 14:32:02.873986 ip-10-0-140-168 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:32:02.876357 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.876276    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 14:32:02.880530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880512    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:32:02.880530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880530    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880534    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880537    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880541    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880544    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880547    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880549    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880552    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880555    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880557    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880560    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880563    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880566    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880570    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880572    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880575    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880578    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880580    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880583    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880585    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:32:02.880597 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880588    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880591    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880593    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880596    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880598    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880601    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880604    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880607    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880610    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880613    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880615    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880617    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880620    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880623    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880625    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880628    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880630    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880634    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880636    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880639    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:32:02.881089 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880642    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880644    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880647    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880649    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880652    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880654    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880657    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880662    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880666    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880669    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880671    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880675    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880679    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880682    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880685    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880688    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880691    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880694    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880697    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:32:02.881579 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880700    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880702    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880705    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880708    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880710    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880713    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880716    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880718    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880721    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880724    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880726    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880729    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880732    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880734    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880737    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880739    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880743    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880746    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880749    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880751    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:32:02.882071 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880754    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880756    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880759    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880761    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880764    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880766    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880769    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880771    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880774    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880777    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880780    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880782    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880784    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880797    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880800    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880803    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880805    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880808    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.880812    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:32:02.882588 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881538    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881545    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881549    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881552    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881555    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881559    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881562    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881565    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881567    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881570    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881572    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881575    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881578    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881581    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881583    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881586    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881590    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881594    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881597    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:32:02.883055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881601    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881603    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881606    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881609    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881612    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881614    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881617    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881619    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881622    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881625    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881627    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881630    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881633    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881635    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881638    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881640    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881643    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881645    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881648    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881651    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:32:02.883537 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881654    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881656    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881658    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881661    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881665    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881667    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881670    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881673    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881675    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881678    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881680    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881683    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881688    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881691    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881694    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881697    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881700    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881702    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881705    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:32:02.884055 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881707    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881710    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881713    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881715    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881718    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881721    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881724    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881726    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881729    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881731    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881734    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881736    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881739    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881742    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881744    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881747    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881750    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881753    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881756    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881758    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:32:02.884531 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881761    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881764    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881766    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881769    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881771    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881774    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881776    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881779    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881783    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881785    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881807    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881811    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881815    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881819    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881824    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881829    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881831    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881834    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881837    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881841    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:32:02.885041 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.881844    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882245    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882251    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882254    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882257    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882260    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882263    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882266    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882268    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882271    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882273    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882276    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882279    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882281    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882284    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882286    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882289    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882292    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882294    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882297    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:32:02.885530 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882300    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882302    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882305    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882307    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882310    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882312    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882315    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882318    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882320    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882323    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882325    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882328    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882330    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882333    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882337    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882340    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882343    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882346    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882349    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:32:02.886021 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882351    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882354    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882356    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882359    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882362    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882365    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882367    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882370    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882372    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882375    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882378    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882381    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882384    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882387    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882389    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882392    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882394    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882399    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882402    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:32:02.886502 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882406    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882410    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882413    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882416    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882418    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882421    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882424    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882427    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882429    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882432    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882434    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882437    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882439    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882442    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882445    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882448    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882450    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882453    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882455    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882457    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:32:02.886978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882460    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882462    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882465    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882468    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882470    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882473    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882475    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882478    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882481    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882483    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882488    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882490    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882493    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882495    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882498    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882501    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882504    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882506    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882510    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882512    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:32:02.887491 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882515    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.882517    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882592    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882605    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882612    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882618    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882622    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882626    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882630    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882634    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882637    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882640    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882644    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882647    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882651    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882654    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882656    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882660    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882663    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882666    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882671    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882674    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882678    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882681    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 14:32:02.888020 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882684    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882688    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882691    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882694    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882697    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882700    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882703    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882706    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882709    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882712    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882717    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882720    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882723    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882727    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882730    2580 flags.go:64] FLAG: --enable-server="true"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882734    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882738    2580 flags.go:64] FLAG: --event-burst="100"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882741    2580 flags.go:64] FLAG: --event-qps="50"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882744    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882747    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882750    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882753    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882756    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882759    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882762    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 24 14:32:02.888615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882765    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882768    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882771    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882774    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882777    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882781    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882783    2580 flags.go:64] FLAG: --feature-gates=""
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882803    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882808    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882813    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882817    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882820    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882823    2580 flags.go:64] FLAG: --help="false"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882826    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-140-168.ec2.internal"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882829    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882832    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882835    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882838    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882842    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882845    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882849    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882852    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882855    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 14:32:02.889273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882859    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882862    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882865    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882868    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882871    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882874    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882877    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882879    2580 flags.go:64] FLAG: --lock-file=""
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882882    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882885    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882888    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882894    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882897    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882899    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882903    2580 flags.go:64] FLAG: --logging-format="text"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882906    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882910    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882913    2580 flags.go:64] FLAG: --manifest-url=""
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882915    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882920    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882923    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882927    2580 flags.go:64] FLAG: --max-pods="110"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882930    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882934    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882936    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 14:32:02.889906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882940    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882942    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882947    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882950    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882959    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882962    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882965    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882968    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882971    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882977    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882980    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882983    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882986    2580 flags.go:64] FLAG: --port="10250"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882989    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882992    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-087a9a74d17b0641a"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882996    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.882999    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883002    2580 flags.go:64] FLAG: --register-node="true"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883004    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883008    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883011    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883015    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883019    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883022    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883025    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 14:32:02.890638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883028    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883031    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883034    2580 flags.go:64] FLAG: --runonce="false"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883037    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883040    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883043    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883046    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883049    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883052    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883055    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883058    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883061    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883066    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883069    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883072    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883075    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883078    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883081    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883087    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883089    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883092    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883098    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883100    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883103    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883106    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 14:32:02.891336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883109    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883112    2580 flags.go:64] FLAG: --v="2"
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883116    2580 flags.go:64] FLAG: --version="false"
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883121    2580 flags.go:64] FLAG: --vmodule=""
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883124    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.883128    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883242    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883245    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883248    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883251    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883254    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883256    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883259    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883262    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883264    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883268    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883272    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883275    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883278    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883283    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:32:02.891997 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883286    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883289    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883292    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883295    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883298    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883302    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883306    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883309    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883311    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883314    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883317    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883319    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883322    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883324    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883327    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883330    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883333    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883335    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883338    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883340    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:32:02.892485 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883343    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883346    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883350    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883353    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883356    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883359    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883362    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883365    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883368    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883371    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883374    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883379    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883381    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883384    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883387    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883389    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883392    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883395    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883397    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:32:02.893104 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883400    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883402    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883405    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883407    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883410    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883412    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883415    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883417    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883420    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883423    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883425    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883427    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883430    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883432    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883435    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883437    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883440    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883443    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883445    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883447    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:32:02.893592 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883450    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883452    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883455    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883457    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883461    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883463    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883466    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883468    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883471    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883474    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883476    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883479    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883482    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883485    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883487    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883490    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883493    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883495    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883498    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883501    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:32:02.894111 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883503    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883505    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883508    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883510    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883513    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.883516    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.884075    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.890902    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.890920    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.891805    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.891814    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891875    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891882    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891885    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:32:02.894602 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891888    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891892    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891896    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891899    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891903    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891905    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891908    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891911    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891914    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891916    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891919    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891922    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891924    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891927    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891929    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891932    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891934    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891937    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891940    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891943    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:32:02.894969 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891946    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891949    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891952    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891954    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891957    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891959    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891963    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891966    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891969    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891971    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891974    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891977    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891979    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891982    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891984    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891987    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891989    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891992    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891994    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.891997    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:32:02.895507 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892000    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892003    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892005    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892008    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892011    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892014    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892017    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892019    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892022    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892025    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892028    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892030    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892033    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892036    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892039    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892043    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892046    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892049    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892053    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:32:02.896047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892056    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892059    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892062    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892064    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892067    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892069    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892072    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892075    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892077    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892080    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892082    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892085    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892087    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892090    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892093    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892095    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892098    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892100    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892103    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:32:02.896510 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892105    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892108    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892110    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892113    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892116    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892119    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892122    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892124    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892127    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892130    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892133    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892137    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892140    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892143    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892147    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892149    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892152    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:32:02.897017 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892155    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.892160    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892296    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892302    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892305    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892309    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892312    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892314    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892317    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892319    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892322    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892325    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892327    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892330    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892332    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:32:02.897449 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892335    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892338    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892340    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892342    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892345    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892348    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892351    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892353    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892356    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892358    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892361    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892364    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892366    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892370    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892374    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892378    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892381    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892384    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892387    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892389    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:32:02.897850 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892392    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892394    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892397    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892399    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892402    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892404    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892407    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892409    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892412    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892414    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892417    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892419    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892422    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892424    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892427    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892430    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892432    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892435    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892438    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892440    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:32:02.898363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892443    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892445    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892447    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892450    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892452    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892455    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892458    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892460    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892463    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892466    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892468    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892471    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892473    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892476    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892478    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892481    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892483    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892486    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892489    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:32:02.898908 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892491    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892494    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892497    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892499    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892502    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892505    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892507    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892510    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892512    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892515    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892517    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892520    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892522    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892526    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892529    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892532    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892535    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892537    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892539    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892542    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:32:02.899391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892545    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892547    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892550    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892552    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892555    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892557    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:02.892562    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.892567    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.892702    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.895289    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.896782    2580 server.go:1019] "Starting client certificate rotation"
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.896893    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.896930    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:32:02.899907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.899356    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:32:02.903708 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.903680    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:32:02.913458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.913437    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 24 14:32:02.915616 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.915597    2580 log.go:25] "Validated CRI v1 image API"
Jul 24 14:32:02.917078 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.917062    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 14:32:02.919973 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.919943    2580 fs.go:135] Filesystem UUIDs: map[38032f4c-8ff7-48ad-bf52-8aef88691725:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f2adbbe0-b01f-4cce-abc9-9c143c688a6a:/dev/nvme0n1p3]
Jul 24 14:32:02.920031 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.919973    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 14:32:02.925172 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.925049    2580 manager.go:216] Machine: {Timestamp:2026-07-24 14:32:02.923836188 +0000 UTC m=+0.275681365 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098792 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b253b49eb72bdc88e0d0de141668a SystemUUID:ec2b253b-49eb-72bd-c88e-0d0de141668a BootID:6d70f505-35f7-4b16-b2a6-e14105c403fc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:06:d7:e9:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:06:d7:e9:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:33:dc:15:e3:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 14:32:02.925172 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.925158    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 14:32:02.925310 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.925281    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 14:32:02.926326 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.926310    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:32:02.928700 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.928670    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 14:32:02.928911 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.928704    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 14:32:02.929898 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.929887    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 14:32:02.929930 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.929901    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 14:32:02.929930 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.929909    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:32:02.930678 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.930666    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:32:02.931413 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.931402    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 14:32:02.933168 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933155    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:32:02.933301 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933291    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 14:32:02.933341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933323    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 14:32:02.933373 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933342    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 14:32:02.933373 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933354    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 14:32:02.933373 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933364    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 24 14:32:02.933493 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933376    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 14:32:02.933853 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933841    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:32:02.933907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.933862    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:32:02.935964 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.935941    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 14:32:02.938041 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.938027    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 14:32:02.938083 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.938059    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 14:32:02.939471 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939460    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 14:32:02.939514 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939476    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 14:32:02.939514 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939483    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 14:32:02.939514 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939489    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 14:32:02.939514 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939498    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 14:32:02.939514 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939504    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 14:32:02.939514 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939513    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 14:32:02.939675 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939519    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 14:32:02.939675 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939525    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 14:32:02.939675 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939532    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 14:32:02.939675 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939541    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 14:32:02.939675 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.939547    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 14:32:02.940824 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.940811    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 14:32:02.940861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.940826    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 14:32:02.944655 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.944627    2580 server.go:1268] "Started kubelet"
Jul 24 14:32:02.944783 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.944757    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:32:02.944875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.944782    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:32:02.944932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.944876    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 14:32:02.944932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.944866    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 14:32:02.944932 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.944902    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:32:02.944932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.944925    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 14:32:02.945640 ip-10-0-140-168 systemd[1]: Started Kubernetes Kubelet.
Jul 24 14:32:02.946553 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.946453    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 14:32:02.946988 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.946975    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 14:32:02.947739 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.947723    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xjmv6"
Jul 24 14:32:02.950066 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.950045    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 14:32:02.950254 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.949397    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-168.ec2.internal.18c5404c1b74bf99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-168.ec2.internal,UID:ip-10-0-140-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-168.ec2.internal,},FirstTimestamp:2026-07-24 14:32:02.944597913 +0000 UTC m=+0.296443093,LastTimestamp:2026-07-24 14:32:02.944597913 +0000 UTC m=+0.296443093,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-168.ec2.internal,}"
Jul 24 14:32:02.953302 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.953289    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 14:32:02.953302 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.953296    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 14:32:02.953444 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.953422    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:02.953842 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.953824    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 14:32:02.953842 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.953844    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 14:32:02.953958 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.953918    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 14:32:02.953958 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.953930    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 14:32:02.954072 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954048    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 14:32:02.954339 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954321    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 14:32:02.954339 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954339    2580 factory.go:55] Registering systemd factory
Jul 24 14:32:02.954339 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954347    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 24 14:32:02.954579 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954562    2580 factory.go:153] Registering CRI-O factory
Jul 24 14:32:02.954579 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954581    2580 factory.go:223] Registration of the crio container factory successfully
Jul 24 14:32:02.954681 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954603    2580 factory.go:103] Registering Raw factory
Jul 24 14:32:02.954681 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.954615    2580 manager.go:1196] Started watching for new ooms in manager
Jul 24 14:32:02.955238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.955006    2580 manager.go:349] Starting recovery of all containers
Jul 24 14:32:02.956581 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.956558    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xjmv6"
Jul 24 14:32:02.957455 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.957429    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:32:02.957550 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.957512    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 14:32:02.966062 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.965975    2580 manager.go:354] Recovery completed
Jul 24 14:32:02.971240 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.971223    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:02.973204 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973185    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:02.973303 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973216    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:02.973303 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973227    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:02.973756 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973741    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 14:32:02.973756 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973754    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 14:32:02.973872 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973770    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:32:02.973872 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.973801    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:02.974486 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.974462    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:02.974545 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.974489    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:02.974545 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.974499    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:02.975293 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.975279    2580 policy_none.go:49] "None policy: Start"
Jul 24 14:32:02.975352 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.975296    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 14:32:02.975352 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.975306    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 14:32:02.975405 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:02.975305    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-168.ec2.internal.18c5404c1d2937bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-168.ec2.internal,UID:ip-10-0-140-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-168.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-168.ec2.internal,},FirstTimestamp:2026-07-24 14:32:02.973202367 +0000 UTC m=+0.325047546,LastTimestamp:2026-07-24 14:32:02.973202367 +0000 UTC m=+0.325047546,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-168.ec2.internal,}"
Jul 24 14:32:02.976322 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:02.976309    2580 policy_none.go:47] "Start"
Jul 24 14:32:03.009589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.009413    2580 manager.go:337] "Starting Device Plugin manager"
Jul 24 14:32:03.009706 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.009609    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 14:32:03.009706 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.009621    2580 server.go:87] "Starting device plugin registration server"
Jul 24 14:32:03.009881 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.009866    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 14:32:03.009929 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.009882    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 14:32:03.009993 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.009975    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 14:32:03.010089 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.010063    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 14:32:03.010089 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.010077    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 14:32:03.010599 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.010581    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 14:32:03.010669 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.010628    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.057056 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.057015    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 14:32:03.060978 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.058354    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 14:32:03.060978 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.058392    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 14:32:03.060978 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.058417    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 14:32:03.060978 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.058459    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 14:32:03.060978 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.060964    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:32:03.110907 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.110876    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:03.111877 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.111859    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:03.111966 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.111887    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:03.111966 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.111897    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:03.111966 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.111921    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.117764 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.117743    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.117870 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.117773    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-168.ec2.internal\": node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.128043 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.127973    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.158530 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.158498    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"]
Jul 24 14:32:03.158663 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.158573    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:03.159836 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.159820    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:03.159930 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.159854    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:03.159930 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.159868    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:03.161143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161127    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:03.161261 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161245    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.161306 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161281    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:03.161947 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161931    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:03.162015 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161935    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:03.162015 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161980    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:03.162015 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161998    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:03.162133 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.161961    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:03.162133 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.162041    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:03.163134 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.163119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.163195 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.163150    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:32:03.163943 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.163927    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:32:03.164012 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.163960    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:32:03.164012 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.163971    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:32:03.179519 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.179493    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-168.ec2.internal\" not found" node="ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.182952 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.182934    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-168.ec2.internal\" not found" node="ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.228337 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.228303    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.329359 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.329327    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.355705 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.355679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25ab27af7a72c33ab0ba6df8ccab1784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal\" (UID: \"25ab27af7a72c33ab0ba6df8ccab1784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.355705 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.355704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25ab27af7a72c33ab0ba6df8ccab1784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal\" (UID: \"25ab27af7a72c33ab0ba6df8ccab1784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.355905 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.355723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cda8959942da19ca79401d79b37cc59f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-168.ec2.internal\" (UID: \"cda8959942da19ca79401d79b37cc59f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.429985 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.429923    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.456453 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.456428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25ab27af7a72c33ab0ba6df8ccab1784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal\" (UID: \"25ab27af7a72c33ab0ba6df8ccab1784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.456550 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.456456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25ab27af7a72c33ab0ba6df8ccab1784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal\" (UID: \"25ab27af7a72c33ab0ba6df8ccab1784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.456550 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.456476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cda8959942da19ca79401d79b37cc59f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-168.ec2.internal\" (UID: \"cda8959942da19ca79401d79b37cc59f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.456550 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.456521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25ab27af7a72c33ab0ba6df8ccab1784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal\" (UID: \"25ab27af7a72c33ab0ba6df8ccab1784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.456550 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.456529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cda8959942da19ca79401d79b37cc59f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-168.ec2.internal\" (UID: \"cda8959942da19ca79401d79b37cc59f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.456678 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.456540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25ab27af7a72c33ab0ba6df8ccab1784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal\" (UID: \"25ab27af7a72c33ab0ba6df8ccab1784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.481558 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.481513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.486201 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.486182    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:03.530404 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.530366    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.636488 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.636435    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.737679 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.737589    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.759987 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.759958    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:32:03.841845 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.841783    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.898584 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.898544    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 14:32:03.899038 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.898725    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 14:32:03.899038 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.898732    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 14:32:03.942808 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:03.942760    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-168.ec2.internal\" not found"
Jul 24 14:32:03.966111 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.966073    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:27:03 +0000 UTC" deadline="2028-02-20 12:05:24.260298046 +0000 UTC"
Jul 24 14:32:03.966111 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.966102    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13821h33m20.294199164s"
Jul 24 14:32:03.994041 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:03.993965    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:32:04.053989 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.053953    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:04.067087 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.067060    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:32:04.067871 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.067849    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal"
Jul 24 14:32:04.079265 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.079241    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:32:04.153288 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.153263    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:32:04.295789 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:04.295748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda8959942da19ca79401d79b37cc59f.slice/crio-c4fbe79478a6ed9dd6ef543ce924104f3fd93cd5b6430fbb5f92bc46e1307196 WatchSource:0}: Error finding container c4fbe79478a6ed9dd6ef543ce924104f3fd93cd5b6430fbb5f92bc46e1307196: Status 404 returned error can't find the container with id c4fbe79478a6ed9dd6ef543ce924104f3fd93cd5b6430fbb5f92bc46e1307196
Jul 24 14:32:04.296031 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:04.296000    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ab27af7a72c33ab0ba6df8ccab1784.slice/crio-7ba1cd034e853d8782890d3e8e3c6a5c7741ddabcccdb97fe38c2687a841ae9f WatchSource:0}: Error finding container 7ba1cd034e853d8782890d3e8e3c6a5c7741ddabcccdb97fe38c2687a841ae9f: Status 404 returned error can't find the container with id 7ba1cd034e853d8782890d3e8e3c6a5c7741ddabcccdb97fe38c2687a841ae9f
Jul 24 14:32:04.299643 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.299627    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:32:04.934772 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.934737    2580 apiserver.go:52] "Watching apiserver"
Jul 24 14:32:04.943448 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.943027    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 14:32:04.945828 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.945757    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xt4ch","kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal","openshift-image-registry/node-ca-f7kpn","openshift-multus/network-metrics-daemon-sfvd7","openshift-network-diagnostics/network-check-target-jts5b","kube-system/konnectivity-agent-rcx6v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp","openshift-cluster-node-tuning-operator/tuned-77q2g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal","openshift-multus/multus-additional-cni-plugins-gvtlt","openshift-multus/multus-s66br","openshift-network-operator/iptables-alerter-76w6l","openshift-ovn-kubernetes/ovnkube-node-2nxmw"]
Jul 24 14:32:04.952414 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.952297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.955661 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.955213    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 14:32:04.955661 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.955452    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 14:32:04.955661 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.955467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lmq8g\""
Jul 24 14:32:04.955661 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.955588    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 14:32:04.955661 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.955646    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 14:32:04.957139 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.957120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:04.959196 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.959172    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:04.959296 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:04.959255    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:04.959706 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.959679    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 14:32:04.959800 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.959782    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 14:32:04.959993 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.959973    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4k888\""
Jul 24 14:32:04.960139 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.960111    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 14:32:04.960737 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.960633    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:04.960737 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:04.960698    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:04.962649 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.962623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.964895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:04.964955    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7xd2\" (UniqueName: \"kubernetes.io/projected/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-kube-api-access-p7xd2\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-host\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-sys-fs\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-serviceca\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvk2\" (UniqueName: \"kubernetes.io/projected/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-kube-api-access-zwvk2\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-socket-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-registration-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-device-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965688    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 14:32:04.966861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.965831    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cd6mt\""
Jul 24 14:32:04.967676 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.967105    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 14:32:04.967676 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.967197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:04.969030 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.969008    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:32:04.969362 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.969344    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:04.969446 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.969352    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:32:04.969777 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.969758    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9gs42\""
Jul 24 14:32:04.972163 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.971942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s66br"
Jul 24 14:32:04.972568 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.972549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 14:32:04.974952 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.974725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:04.977123 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.976688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:04.977229 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.977157    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 14:32:04.977860 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.977839    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 14:32:04.978403 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.978382    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 14:32:04.978686 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.978664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 14:32:04.980071 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.979999    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 14:32:04.981311 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.981287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jv28m\""
Jul 24 14:32:04.981421 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.981323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hchwr\""
Jul 24 14:32:04.981890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.981868    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:32:04.982085 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.982065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 14:32:04.982644 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.982625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983011    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wpl8t\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983043    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983462    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983704    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983896    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 14:32:04.983982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.983942    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5jqhd\""
Jul 24 14:32:04.984399 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:04.984221    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 14:32:05.056051 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.056024    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 14:32:05.060407 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.060380    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6c6dq"
Jul 24 14:32:05.065609 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal" event={"ID":"cda8959942da19ca79401d79b37cc59f","Type":"ContainerStarted","Data":"c4fbe79478a6ed9dd6ef543ce924104f3fd93cd5b6430fbb5f92bc46e1307196"}
Jul 24 14:32:05.065828 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvk2\" (UniqueName: \"kubernetes.io/projected/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-kube-api-access-zwvk2\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.065919 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-os-release\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.065919 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-dbus\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.065919 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-var-lib-kubelet\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.066086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4jj\" (UniqueName: \"kubernetes.io/projected/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-kube-api-access-pq4jj\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.066086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-run-netns\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.066086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.065995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-registration-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.066086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/11c98a1d-b504-4ad9-b83c-b926ef1b1751-iptables-alerter-script\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.066086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-system-cni-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-cni-netd\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfh5\" (UniqueName: \"kubernetes.io/projected/11c98a1d-b504-4ad9-b83c-b926ef1b1751-kube-api-access-nzfh5\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-daemon-config\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7xd2\" (UniqueName: \"kubernetes.io/projected/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-kube-api-access-p7xd2\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-run\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-host\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-cni-multus\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-systemd\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-serviceca\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.066341 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cnibin\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11c98a1d-b504-4ad9-b83c-b926ef1b1751-host-slash\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysconfig\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysctl-conf\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-systemd\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-cni-bin\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-ovn\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-system-cni-dir\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88a17919-0477-477c-b0d5-f67cdeebf42d-agent-certs\") pod \"konnectivity-agent-rcx6v\" (UID: \"88a17919-0477-477c-b0d5-f67cdeebf42d\") " pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-tuned\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-cni-binary-copy\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-slash\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-env-overrides\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovn-node-metrics-cert\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-sys-fs\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.067023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-kubelet\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-conf-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-systemd-units\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bf6\" (UniqueName: \"kubernetes.io/projected/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-kube-api-access-b8bf6\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-modprobe-d\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-k8s-cni-cncf-io\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-kubelet\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-var-lib-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88a17919-0477-477c-b0d5-f67cdeebf42d-konnectivity-ca\") pod \"konnectivity-agent-rcx6v\" (UID: \"88a17919-0477-477c-b0d5-f67cdeebf42d\") " pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-kubelet-config\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovnkube-config\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-sys\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.066989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z7sb\" (UniqueName: \"kubernetes.io/projected/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-kube-api-access-8z7sb\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.067809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-netns\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067043    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-etc-kubernetes\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovnkube-script-lib\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-kubernetes\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-lib-modules\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-hostroot\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-etc-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-node-log\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-log-socket\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-cnibin\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-cni-bin\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-tmp\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-os-release\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-multus-certs\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qbv6\" (UniqueName: \"kubernetes.io/projected/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-kube-api-access-4qbv6\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.068621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysctl-d\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-cni-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-socket-dir-parent\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9zr\" (UniqueName: \"kubernetes.io/projected/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-kube-api-access-gj9zr\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-socket-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-device-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-host\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.067958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.068366    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-registration-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.068485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.069113    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-serviceca\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.069527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.069279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-sys-fs\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.070264 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.069589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-socket-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.070264 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.069643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-device-dir\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.070264 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.069689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-host\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.070264 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.070009    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6c6dq"
Jul 24 14:32:05.071307 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.071273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal" event={"ID":"25ab27af7a72c33ab0ba6df8ccab1784","Type":"ContainerStarted","Data":"7ba1cd034e853d8782890d3e8e3c6a5c7741ddabcccdb97fe38c2687a841ae9f"}
Jul 24 14:32:05.073249 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.073220    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:32:05.079515 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.079489    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 14:32:05.083679 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.083641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvk2\" (UniqueName: \"kubernetes.io/projected/082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8-kube-api-access-zwvk2\") pod \"node-ca-f7kpn\" (UID: \"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8\") " pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.089731 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.089703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7xd2\" (UniqueName: \"kubernetes.io/projected/8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70-kube-api-access-p7xd2\") pod \"aws-ebs-csi-driver-node-gmhjp\" (UID: \"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.168146 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfh5\" (UniqueName: \"kubernetes.io/projected/11c98a1d-b504-4ad9-b83c-b926ef1b1751-kube-api-access-nzfh5\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-daemon-config\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-run\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-host\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-cni-multus\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-systemd\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cnibin\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.168334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11c98a1d-b504-4ad9-b83c-b926ef1b1751-host-slash\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysconfig\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-host\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysctl-conf\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-run\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-systemd\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-cni-bin\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11c98a1d-b504-4ad9-b83c-b926ef1b1751-host-slash\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-ovn\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-ovn\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-system-cni-dir\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88a17919-0477-477c-b0d5-f67cdeebf42d-agent-certs\") pod \"konnectivity-agent-rcx6v\" (UID: \"88a17919-0477-477c-b0d5-f67cdeebf42d\") " pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-tuned\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-cni-bin\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-cni-binary-copy\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-slash\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysctl-conf\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-env-overrides\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.168747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-system-cni-dir\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovn-node-metrics-cert\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-systemd\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysconfig\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-daemon-config\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-cni-multus\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168660    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cnibin\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-cni-binary-copy\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-env-overrides\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-slash\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.169502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.168558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-systemd\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.170000 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.170000 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-kubelet\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170000 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-conf-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170000 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-systemd-units\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170000 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.169792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-var-lib-kubelet\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-conf-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-systemd-units\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bf6\" (UniqueName: \"kubernetes.io/projected/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-kube-api-access-b8bf6\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-modprobe-d\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-k8s-cni-cncf-io\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-kubelet\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-var-lib-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170376 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88a17919-0477-477c-b0d5-f67cdeebf42d-konnectivity-ca\") pod \"konnectivity-agent-rcx6v\" (UID: \"88a17919-0477-477c-b0d5-f67cdeebf42d\") " pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-kubelet-config\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovnkube-config\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-sys\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z7sb\" (UniqueName: \"kubernetes.io/projected/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-kube-api-access-8z7sb\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-netns\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-etc-kubernetes\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovnkube-script-lib\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-kubernetes\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-lib-modules\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-hostroot\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-etc-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.170890 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.171706 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.171529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-node-log\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-log-socket\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-cnibin\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-cni-bin\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-tmp\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-os-release\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-multus-certs\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbv6\" (UniqueName: \"kubernetes.io/projected/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-kube-api-access-4qbv6\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysctl-d\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-cni-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-socket-dir-parent\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9zr\" (UniqueName: \"kubernetes.io/projected/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-kube-api-access-gj9zr\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.172995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.174798 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-os-release\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-dbus\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-var-lib-kubelet\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4jj\" (UniqueName: \"kubernetes.io/projected/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-kube-api-access-pq4jj\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-run-netns\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/11c98a1d-b504-4ad9-b83c-b926ef1b1751-iptables-alerter-script\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-system-cni-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-cni-netd\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-node-log\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-log-socket\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-cnibin\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.173834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-cni-bin\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.174419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.175272    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-tuned\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.175767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.175655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovn-node-metrics-cert\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.176661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-k8s-cni-cncf-io\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-modprobe-d\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88a17919-0477-477c-b0d5-f67cdeebf42d-agent-certs\") pod \"konnectivity-agent-rcx6v\" (UID: \"88a17919-0477-477c-b0d5-f67cdeebf42d\") " pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-var-lib-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-os-release\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-kubelet\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-multus-certs\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-lib-modules\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovnkube-script-lib\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.170643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-kubernetes\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177835    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-etc-sysctl-d\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.177972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-sys\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-kubelet-config\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-cni-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178226    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88a17919-0477-477c-b0d5-f67cdeebf42d-konnectivity-ca\") pod \"konnectivity-agent-rcx6v\" (UID: \"88a17919-0477-477c-b0d5-f67cdeebf42d\") " pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-host-run-netns\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.179313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-ovnkube-config\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.178707    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.178737    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.178825    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:05.678783856 +0000 UTC m=+3.030629084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.178846    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:05.678834476 +0000 UTC m=+3.030679641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.178855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-dbus\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-system-cni-dir\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/11c98a1d-b504-4ad9-b83c-b926ef1b1751-iptables-alerter-script\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-etc-kubernetes\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-os-release\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-var-lib-kubelet\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-run-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-multus-socket-dir-parent\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-run-netns\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-etc-openvswitch\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-hostroot\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.180722 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.180459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-tmp\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.181748 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.179345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-host-cni-netd\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.184841 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.184779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfh5\" (UniqueName: \"kubernetes.io/projected/11c98a1d-b504-4ad9-b83c-b926ef1b1751-kube-api-access-nzfh5\") pod \"iptables-alerter-76w6l\" (UID: \"11c98a1d-b504-4ad9-b83c-b926ef1b1751\") " pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.186104 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.186075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bf6\" (UniqueName: \"kubernetes.io/projected/6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f-kube-api-access-b8bf6\") pod \"multus-additional-cni-plugins-gvtlt\" (UID: \"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f\") " pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.190604 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.190575    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:05.190604 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.190604    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:05.190776 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.190622    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:05.190776 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.190702    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:05.690679807 +0000 UTC m=+3.042524992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:05.192424 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.192395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9zr\" (UniqueName: \"kubernetes.io/projected/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-kube-api-access-gj9zr\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:05.193580 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.193536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z7sb\" (UniqueName: \"kubernetes.io/projected/5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8-kube-api-access-8z7sb\") pod \"tuned-77q2g\" (UID: \"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8\") " pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.194216 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.194172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4jj\" (UniqueName: \"kubernetes.io/projected/d97cd8c6-9e80-4841-87f8-f82fcbcb266a-kube-api-access-pq4jj\") pod \"multus-s66br\" (UID: \"d97cd8c6-9e80-4841-87f8-f82fcbcb266a\") " pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.194534 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.194503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qbv6\" (UniqueName: \"kubernetes.io/projected/e155dd26-b5d5-47d7-bae1-03edd63fe9e3-kube-api-access-4qbv6\") pod \"ovnkube-node-2nxmw\" (UID: \"e155dd26-b5d5-47d7-bae1-03edd63fe9e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.269847 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.269793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp"
Jul 24 14:32:05.277924 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.277894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7kpn"
Jul 24 14:32:05.289949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.289923    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:05.299071 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.299045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77q2g"
Jul 24 14:32:05.309992 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.309964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvtlt"
Jul 24 14:32:05.315980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.315960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s66br"
Jul 24 14:32:05.326947 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.326928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-76w6l"
Jul 24 14:32:05.333969 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.333945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:05.778037 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.777994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:05.778225 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.778070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:05.778225 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:05.778101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:05.778365 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778227    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:05.778365 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778243    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:05.778365 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778253    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:05.778365 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778315    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:06.778299204 +0000 UTC m=+4.130144369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:05.778365 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778330    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:05.778630 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778409    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:06.778391766 +0000 UTC m=+4.130236932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:05.778630 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778331    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:05.778630 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:05.778458    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:06.778447418 +0000 UTC m=+4.130292586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:06.073980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:06.073879    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:27:05 +0000 UTC" deadline="2028-02-13 12:48:37.056508977 +0000 UTC"
Jul 24 14:32:06.073980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:06.073919    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13654h16m30.982594404s"
Jul 24 14:32:06.351773 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.351740    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef31595_a9d5_46bc_bc1b_1ae1e62f2a70.slice/crio-859c5f518a972f58585dab6bf38f2e85a0e90fdcdf67cf730fa4c32ae4bf09a6 WatchSource:0}: Error finding container 859c5f518a972f58585dab6bf38f2e85a0e90fdcdf67cf730fa4c32ae4bf09a6: Status 404 returned error can't find the container with id 859c5f518a972f58585dab6bf38f2e85a0e90fdcdf67cf730fa4c32ae4bf09a6
Jul 24 14:32:06.352772 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.352748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a17919_0477_477c_b0d5_f67cdeebf42d.slice/crio-cca29770188d8895434cf51e8c6c766c6bc05d64cc3c1cf6a90f14b5c483097a WatchSource:0}: Error finding container cca29770188d8895434cf51e8c6c766c6bc05d64cc3c1cf6a90f14b5c483097a: Status 404 returned error can't find the container with id cca29770188d8895434cf51e8c6c766c6bc05d64cc3c1cf6a90f14b5c483097a
Jul 24 14:32:06.354299 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.354129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97cd8c6_9e80_4841_87f8_f82fcbcb266a.slice/crio-d13a2daf76953c4db85de522e2282de3caab251162760c48bec8a8bd462497ce WatchSource:0}: Error finding container d13a2daf76953c4db85de522e2282de3caab251162760c48bec8a8bd462497ce: Status 404 returned error can't find the container with id d13a2daf76953c4db85de522e2282de3caab251162760c48bec8a8bd462497ce
Jul 24 14:32:06.358741 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.358715    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c98a1d_b504_4ad9_b83c_b926ef1b1751.slice/crio-5e566dabbeac28d9ae095b39ce7d6dad916534f85e091b8c1dcd99bfadc8da04 WatchSource:0}: Error finding container 5e566dabbeac28d9ae095b39ce7d6dad916534f85e091b8c1dcd99bfadc8da04: Status 404 returned error can't find the container with id 5e566dabbeac28d9ae095b39ce7d6dad916534f85e091b8c1dcd99bfadc8da04
Jul 24 14:32:06.359172 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.359152    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082dbcf0_d2ee_4854_a7a0_6ca0df0b06c8.slice/crio-05d9d50c2580276130740bb2ae912a07d1c8fe3f46b0fdd599765a12b18a9934 WatchSource:0}: Error finding container 05d9d50c2580276130740bb2ae912a07d1c8fe3f46b0fdd599765a12b18a9934: Status 404 returned error can't find the container with id 05d9d50c2580276130740bb2ae912a07d1c8fe3f46b0fdd599765a12b18a9934
Jul 24 14:32:06.360149 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.360122    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode155dd26_b5d5_47d7_bae1_03edd63fe9e3.slice/crio-d3d3ac8178070445013f2a2f5952c32926a7fb3f826a5901421e41cfc2182342 WatchSource:0}: Error finding container d3d3ac8178070445013f2a2f5952c32926a7fb3f826a5901421e41cfc2182342: Status 404 returned error can't find the container with id d3d3ac8178070445013f2a2f5952c32926a7fb3f826a5901421e41cfc2182342
Jul 24 14:32:06.361363 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:06.361342    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf84b86_e3a1_45cf_bd1f_7ea52b68faf8.slice/crio-f975af9ae4eed746fef302416ca964400a30316af53edbe790b0f03197aabab5 WatchSource:0}: Error finding container f975af9ae4eed746fef302416ca964400a30316af53edbe790b0f03197aabab5: Status 404 returned error can't find the container with id f975af9ae4eed746fef302416ca964400a30316af53edbe790b0f03197aabab5
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:06.785174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785470    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:06.785491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:06.785530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785600    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:08.785578515 +0000 UTC m=+6.137423683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785672    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785708    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:08.785697338 +0000 UTC m=+6.137542502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785791    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785807    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785820    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:06.785954 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:06.785858    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:08.785846105 +0000 UTC m=+6.137691287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:06.866625 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:06.866588    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:32:07.061897 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.061806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:07.062062 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:07.061974    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:07.063078 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.062410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:07.063078 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:07.062515    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:07.063078 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.062615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:07.063078 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:07.062696    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:07.074764 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.074700    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:27:05 +0000 UTC" deadline="2028-03-16 04:53:12.020044617 +0000 UTC"
Jul 24 14:32:07.074764 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.074733    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14414h21m4.945316659s"
Jul 24 14:32:07.083539 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.082500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerStarted","Data":"038390f5333101f7b267d60078c1537801a36091292400556fe41d032892dfb5"}
Jul 24 14:32:07.092633 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.092571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7kpn" event={"ID":"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8","Type":"ContainerStarted","Data":"05d9d50c2580276130740bb2ae912a07d1c8fe3f46b0fdd599765a12b18a9934"}
Jul 24 14:32:07.099644 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.099613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp" event={"ID":"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70","Type":"ContainerStarted","Data":"859c5f518a972f58585dab6bf38f2e85a0e90fdcdf67cf730fa4c32ae4bf09a6"}
Jul 24 14:32:07.118025 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.117993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77q2g" event={"ID":"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8","Type":"ContainerStarted","Data":"f975af9ae4eed746fef302416ca964400a30316af53edbe790b0f03197aabab5"}
Jul 24 14:32:07.121096 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.121033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"d3d3ac8178070445013f2a2f5952c32926a7fb3f826a5901421e41cfc2182342"}
Jul 24 14:32:07.127496 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.127467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-76w6l" event={"ID":"11c98a1d-b504-4ad9-b83c-b926ef1b1751","Type":"ContainerStarted","Data":"5e566dabbeac28d9ae095b39ce7d6dad916534f85e091b8c1dcd99bfadc8da04"}
Jul 24 14:32:07.140667 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.140635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s66br" event={"ID":"d97cd8c6-9e80-4841-87f8-f82fcbcb266a","Type":"ContainerStarted","Data":"d13a2daf76953c4db85de522e2282de3caab251162760c48bec8a8bd462497ce"}
Jul 24 14:32:07.142388 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.142357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rcx6v" event={"ID":"88a17919-0477-477c-b0d5-f67cdeebf42d","Type":"ContainerStarted","Data":"cca29770188d8895434cf51e8c6c766c6bc05d64cc3c1cf6a90f14b5c483097a"}
Jul 24 14:32:07.156618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.156586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal" event={"ID":"cda8959942da19ca79401d79b37cc59f","Type":"ContainerStarted","Data":"9b4b77d8410975e4af43fbd327b49a3c12598241e384d3bea062bee592ee6430"}
Jul 24 14:32:07.161866 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.161464    2580 generic.go:356] "Generic (PLEG): container finished" podID="25ab27af7a72c33ab0ba6df8ccab1784" containerID="2458cf0522fde574dbe380c4bb359e3e251ab16a9605eaadfd9362f10daf8938" exitCode=0
Jul 24 14:32:07.161866 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.161518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal" event={"ID":"25ab27af7a72c33ab0ba6df8ccab1784","Type":"ContainerDied","Data":"2458cf0522fde574dbe380c4bb359e3e251ab16a9605eaadfd9362f10daf8938"}
Jul 24 14:32:07.192107 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:07.191081    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-168.ec2.internal" podStartSLOduration=3.191058548 podStartE2EDuration="3.191058548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:07.174758726 +0000 UTC m=+4.526603916" watchObservedRunningTime="2026-07-24 14:32:07.191058548 +0000 UTC m=+4.542903738"
Jul 24 14:32:08.182373 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:08.182336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal" event={"ID":"25ab27af7a72c33ab0ba6df8ccab1784","Type":"ContainerStarted","Data":"8c625e5f56216c294664a49662961dbb152da246fe63c446d3dd4c5c26cb34b9"}
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:08.806962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:08.807018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:08.807069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807147    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807179    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807220    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:12.807199008 +0000 UTC m=+10.159044200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807244    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:12.807233055 +0000 UTC m=+10.159078226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807294    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807309    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807322    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:08.807393 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:08.807364    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:12.807347353 +0000 UTC m=+10.159192524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:09.060143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:09.059985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:09.060143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:09.060034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:09.060143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:09.059984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:09.060435 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:09.060152    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:09.060435 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:09.060293    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:09.060435 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:09.060388    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:11.060254 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:11.060224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:11.064163 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:11.064117    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:11.064816 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:11.064608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:11.064816 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:11.064745    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:11.065021 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:11.064821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:11.065021 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:11.064936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:12.845420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:12.845484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:12.845525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845555    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845620    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.845602505 +0000 UTC m=+18.197447689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845631    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845663    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.845653334 +0000 UTC m=+18.197498500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845676    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:12.845688 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845705    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:12.846552 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845718    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:12.846552 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:12.845773    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.845754502 +0000 UTC m=+18.197599682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:13.060824 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:13.060126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:13.060824 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:13.060237    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:13.060824 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:13.060591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:13.060824 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:13.060688    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:13.060824 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:13.060748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:13.061113 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:13.060836    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:15.059404 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:15.059350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:15.059886 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:15.059495    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:15.059965 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:15.059896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:15.060012 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:15.059990    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:15.060059 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:15.060039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:15.060133 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:15.060107    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:17.059317 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:17.059270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:17.059317 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:17.059271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:17.059787 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:17.059272    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:17.059787 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:17.059440    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:17.059787 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:17.059524    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:17.059787 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:17.059601    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:19.059642 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:19.059602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:19.060139 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:19.059602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:19.060139 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:19.059752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:19.060139 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:19.059744    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:19.060139 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:19.059959    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:19.060322 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:19.060137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:20.194434 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.194384    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-168.ec2.internal" podStartSLOduration=16.194367316 podStartE2EDuration="16.194367316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:08.201708668 +0000 UTC m=+5.553553859" watchObservedRunningTime="2026-07-24 14:32:20.194367316 +0000 UTC m=+17.546212501"
Jul 24 14:32:20.194910 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.194888    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-p98nd"]
Jul 24 14:32:20.213765 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.213729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.216390 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.216364    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 14:32:20.216497 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.216364    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sh44r\""
Jul 24 14:32:20.217414 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.217389    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 14:32:20.300515 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.300475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6td9\" (UniqueName: \"kubernetes.io/projected/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-kube-api-access-v6td9\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.300515 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.300523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-hosts-file\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.300765 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.300613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-tmp-dir\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.401980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.401937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-hosts-file\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.402150 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.402001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-tmp-dir\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.402150 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.402086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6td9\" (UniqueName: \"kubernetes.io/projected/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-kube-api-access-v6td9\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.402336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.402307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-hosts-file\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.402571 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.402551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-tmp-dir\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.414574 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.414545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6td9\" (UniqueName: \"kubernetes.io/projected/4edef46f-1fc9-4f63-af71-1b0fcec2ca6f-kube-api-access-v6td9\") pod \"node-resolver-p98nd\" (UID: \"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f\") " pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.524042 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.523962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p98nd"
Jul 24 14:32:20.906308 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.906223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:20.906308 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.906277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:20.906315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906395    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906436    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906455    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906466    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:36.906448076 +0000 UTC m=+34.258293241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906474    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906487    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906489    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:36.906473201 +0000 UTC m=+34.258318379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:20.906516 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:20.906522    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:32:36.906511587 +0000 UTC m=+34.258356763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:21.059255 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:21.059218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:21.059407 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:21.059258    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:21.059407 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:21.059218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:21.059407 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:21.059363    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:21.059578 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:21.059445    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:21.059578 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:21.059556    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:23.059840 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:23.059804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:23.060295 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:23.059872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:23.060295 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:23.059884    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:23.060295 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:23.059993    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:23.060295 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:23.060053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:23.060295 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:23.060130    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:24.738038 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:24.738008    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edef46f_1fc9_4f63_af71_1b0fcec2ca6f.slice/crio-25917c69dbb7a4cbabd36920c813294a713e77ddc513cb4a8a9586f16a88d197 WatchSource:0}: Error finding container 25917c69dbb7a4cbabd36920c813294a713e77ddc513cb4a8a9586f16a88d197: Status 404 returned error can't find the container with id 25917c69dbb7a4cbabd36920c813294a713e77ddc513cb4a8a9586f16a88d197
Jul 24 14:32:25.059875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.059580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:25.060055 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:25.059980    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:25.060055 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.059580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:25.060153 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.059685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:25.060153 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:25.060113    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:25.060248 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:25.060220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:25.218170 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.218145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp" event={"ID":"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70","Type":"ContainerStarted","Data":"68db4e149816475efbb6bd2d6dbd0d829e0c5b646333e3d4dc9ce07285afd141"}
Jul 24 14:32:25.219412 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.219386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77q2g" event={"ID":"5cf84b86-e3a1-45cf-bd1f-7ea52b68faf8","Type":"ContainerStarted","Data":"60fcf78fe82a01b7e0b8efe36844188a73d1a469c2018368472633ec8c5e5d59"}
Jul 24 14:32:25.221431 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.221409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"871b3f33b6b0732c521a1c5712596b28641fb3319c30c9ed91ed420dc6e01408"}
Jul 24 14:32:25.221527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.221473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"c7b1c0e012d5f8a901955398a084a30bf6f599a6966846b6216688a4aa898ee0"}
Jul 24 14:32:25.221527 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.221511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"409bc1039aca972b33d295ea1050f0a07738c123eb2756d43345907fed1e4f80"}
Jul 24 14:32:25.222963 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.222926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s66br" event={"ID":"d97cd8c6-9e80-4841-87f8-f82fcbcb266a","Type":"ContainerStarted","Data":"e20c2bfd95fdcfb91a8224322241ae22de79d1ec8ad105571b9b3784592a9b3d"}
Jul 24 14:32:25.224522 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.224502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rcx6v" event={"ID":"88a17919-0477-477c-b0d5-f67cdeebf42d","Type":"ContainerStarted","Data":"fd94a4e33d10a036a7865895b435c21aeeedc80d8c4fe355e1bf976ecd130c56"}
Jul 24 14:32:25.225842 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.225815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p98nd" event={"ID":"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f","Type":"ContainerStarted","Data":"736607781a1ebaae25a06e4309d26152f92c424c7c1a59e4489efcbc0014d2fc"}
Jul 24 14:32:25.225993 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.225860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p98nd" event={"ID":"4edef46f-1fc9-4f63-af71-1b0fcec2ca6f","Type":"ContainerStarted","Data":"25917c69dbb7a4cbabd36920c813294a713e77ddc513cb4a8a9586f16a88d197"}
Jul 24 14:32:25.227209 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.227189    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f" containerID="705737cf85e4edeeda7348f9a3b451eb9f55d0e4e1cd9ea4a226a3d6bace2cda" exitCode=0
Jul 24 14:32:25.227314 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.227251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerDied","Data":"705737cf85e4edeeda7348f9a3b451eb9f55d0e4e1cd9ea4a226a3d6bace2cda"}
Jul 24 14:32:25.228595 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.228574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7kpn" event={"ID":"082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8","Type":"ContainerStarted","Data":"87ea839fd6589a8838166735d10bcb91e8d623d553d39cf5e5f068b30a10f3bb"}
Jul 24 14:32:25.236684 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.236603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-77q2g" podStartSLOduration=3.866513635 podStartE2EDuration="22.236591587s" totalImagesPullingTime="18.370077952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:25.236234694 +0000 UTC m=+22.588079878" watchObservedRunningTime="2026-07-24 14:32:25.236591587 +0000 UTC m=+22.588436772"
Jul 24 14:32:25.251318 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.251275    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f7kpn" podStartSLOduration=3.882298443 podStartE2EDuration="22.251257809s" totalImagesPullingTime="18.368959366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:25.250903601 +0000 UTC m=+22.602748788" watchObservedRunningTime="2026-07-24 14:32:25.251257809 +0000 UTC m=+22.603102995"
Jul 24 14:32:25.264723 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.264686    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rcx6v" podStartSLOduration=7.989296195 podStartE2EDuration="22.264670983s" totalImagesPullingTime="14.275374788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:25.264536804 +0000 UTC m=+22.616381988" watchObservedRunningTime="2026-07-24 14:32:25.264670983 +0000 UTC m=+22.616516167"
Jul 24 14:32:25.307717 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:25.307669    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s66br" podStartSLOduration=3.878231596 podStartE2EDuration="22.307654688s" totalImagesPullingTime="18.429423092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:25.307344436 +0000 UTC m=+22.659189622" watchObservedRunningTime="2026-07-24 14:32:25.307654688 +0000 UTC m=+22.659499873"
Jul 24 14:32:26.192662 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.192623    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 14:32:26.234764 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.234719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"804b29c82ebcbd6ad1a9aba23d316a8adda525e40d26f4abe873dc42cb6cbee9"}
Jul 24 14:32:26.234966 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.234869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"9a96cefb8242762276cd70b91112d1159ccbcb8cd2f8cc152194578deb459548"}
Jul 24 14:32:26.234966 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.234922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"af72b817670c41e113d7b94b1a34db6b8059852d3aae6cc65e7c6fb9590e412d"}
Jul 24 14:32:26.236378 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.236343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-76w6l" event={"ID":"11c98a1d-b504-4ad9-b83c-b926ef1b1751","Type":"ContainerStarted","Data":"42dd477be55682f185a371db92db1e75ffe4cf23a8e93b311552d76c55f83c0b"}
Jul 24 14:32:26.238180 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.238154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp" event={"ID":"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70","Type":"ContainerStarted","Data":"6c769b9af0df84655f7a39a252bd7c985f49c95d12f981f878fdc3db8fce87f6"}
Jul 24 14:32:26.251753 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.251697    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-76w6l" podStartSLOduration=4.880309381 podStartE2EDuration="23.251678263s" totalImagesPullingTime="18.371368882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:26.251403374 +0000 UTC m=+23.603248558" watchObservedRunningTime="2026-07-24 14:32:26.251678263 +0000 UTC m=+23.603523450"
Jul 24 14:32:26.252300 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:26.252260    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p98nd" podStartSLOduration=6.252251456 podStartE2EDuration="6.252251456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:25.324271617 +0000 UTC m=+22.676116801" watchObservedRunningTime="2026-07-24 14:32:26.252251456 +0000 UTC m=+23.604096641"
Jul 24 14:32:27.022991 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:27.022876    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:32:26.192645462Z","UUID":"c271ae97-eda8-4978-bdfd-9dea68b89d2d","Handler":null,"Name":"","Endpoint":""}
Jul 24 14:32:27.024517 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:27.024454    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 14:32:27.024517 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:27.024489    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 14:32:27.058779 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:27.058750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:27.058982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:27.058757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:27.058982 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:27.058936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:27.059099 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:27.058989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:27.059099 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:27.059086    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:27.059198 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:27.059174    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:28.245621 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:28.245583    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp" event={"ID":"8ef31595-a9d5-46bc-bc1b-1ae1e62f2a70","Type":"ContainerStarted","Data":"aa43e6475f57672e2014ba7dde787705cab6d31775ce7a8fabbad819ddca1d45"}
Jul 24 14:32:28.249223 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:28.249190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"f0fa3663204335ace86f6ab5810e32d0246ac4bc1cb0ba0f9642f40e498f5bfa"}
Jul 24 14:32:28.267515 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:28.267457    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmhjp" podStartSLOduration=4.692432534 podStartE2EDuration="25.267437206s" totalImagesPullingTime="20.575004672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:28.266824363 +0000 UTC m=+25.618669549" watchObservedRunningTime="2026-07-24 14:32:28.267437206 +0000 UTC m=+25.619282394"
Jul 24 14:32:29.059438 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:29.059402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:29.059438 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:29.059425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:29.059672 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:29.059402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:29.059672 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:29.059535    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:29.059672 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:29.059611    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:29.059848 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:29.059666    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:30.075817 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:30.075567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:30.076463 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:30.076159    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:30.254940 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:30.254859    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f" containerID="5b34f98c5a73f80faa729a1e2e1d3bcda3848fd324c51fd2f6f487a9adc3f388" exitCode=0
Jul 24 14:32:30.255130 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:30.254950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerDied","Data":"5b34f98c5a73f80faa729a1e2e1d3bcda3848fd324c51fd2f6f487a9adc3f388"}
Jul 24 14:32:30.258809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:30.258768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" event={"ID":"e155dd26-b5d5-47d7-bae1-03edd63fe9e3","Type":"ContainerStarted","Data":"5fab4e83faedc6e524d80d1262efc9bcad8c877d84f808cd227e76f8b86ecec8"}
Jul 24 14:32:30.310041 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:30.309990    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw" podStartSLOduration=8.879175629 podStartE2EDuration="27.309973747s" totalImagesPullingTime="18.430798118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.308507492 +0000 UTC m=+27.660352676" watchObservedRunningTime="2026-07-24 14:32:30.309973747 +0000 UTC m=+27.661818931"
Jul 24 14:32:31.059509 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.059469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:31.059663 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.059522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:31.059663 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.059468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:31.059663 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:31.059599    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:31.059805 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:31.059659    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:31.059805 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:31.059749    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:31.261604 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.261375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:31.262034 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.261656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:31.262034 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.261708    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:31.276439 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.276403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:31.276618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.276549    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:32:31.767547 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.767469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xt4ch"]
Jul 24 14:32:31.767764 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.767586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:31.767764 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:31.767704    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:31.768339 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.768304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sfvd7"]
Jul 24 14:32:31.768482 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.768465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:31.768953 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:31.768565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:31.769124 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.769107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jts5b"]
Jul 24 14:32:31.769198 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:31.769186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:31.769303 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:31.769276    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:32.265500 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:32.265409    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f" containerID="cacd063daf83e4da7fdf8322105e4e9b0ab6cca82a0cdaf29346ed8d35eb4e6c" exitCode=0
Jul 24 14:32:32.265950 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:32.265494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerDied","Data":"cacd063daf83e4da7fdf8322105e4e9b0ab6cca82a0cdaf29346ed8d35eb4e6c"}
Jul 24 14:32:32.396670 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:32.396646    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p98nd_4edef46f-1fc9-4f63-af71-1b0fcec2ca6f/dns-node-resolver/0.log"
Jul 24 14:32:32.957114 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:32.957084    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7kpn_082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8/node-ca/0.log"
Jul 24 14:32:33.060729 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:33.060693    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:33.060898 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:33.060818    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:33.060898 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:33.060856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:33.061030 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:33.060944    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:34.059595 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:34.059437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:34.060001 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:34.059721    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:34.271931 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:34.271899    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f" containerID="012ae271c7205353de89229fe4da37c2df2de6605baa84fb0a55ff4629c9c316" exitCode=0
Jul 24 14:32:34.272093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:34.271942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerDied","Data":"012ae271c7205353de89229fe4da37c2df2de6605baa84fb0a55ff4629c9c316"}
Jul 24 14:32:34.441101 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:34.441024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:34.441243 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:34.441148    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 14:32:34.441606 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:34.441590    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rcx6v"
Jul 24 14:32:35.059720 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:35.059690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:35.060187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:35.059690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:35.060187 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:35.059833    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:35.060187 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:35.059875    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:36.059644 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:36.059613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:36.059958 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.059740    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:36.926219 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:36.926180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:36.926419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:36.926228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:36.926419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:36.926265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:36.926419 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926347    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:36.926419 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926408    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs podName:24e3cf1b-bab5-4b34-b77b-715ed53a01d9 nodeName:}" failed. No retries permitted until 2026-07-24 14:33:08.926389147 +0000 UTC m=+66.278234329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs") pod "network-metrics-daemon-sfvd7" (UID: "24e3cf1b-bab5-4b34-b77b-715ed53a01d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:32:36.926612 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926444    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:32:36.926612 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926467    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:36.926612 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926532    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret podName:05ffa7a9-abf2-43ac-b9ee-499a0a5d095e nodeName:}" failed. No retries permitted until 2026-07-24 14:33:08.926513567 +0000 UTC m=+66.278358750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret") pod "global-pull-secret-syncer-xt4ch" (UID: "05ffa7a9-abf2-43ac-b9ee-499a0a5d095e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:32:36.926612 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926470    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:32:36.926612 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926558    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lv7c6 for pod openshift-network-diagnostics/network-check-target-jts5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:36.926612 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:36.926588    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6 podName:b2e7eee0-e2b6-4b05-8977-448f597db52e nodeName:}" failed. No retries permitted until 2026-07-24 14:33:08.926581002 +0000 UTC m=+66.278426166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lv7c6" (UniqueName: "kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6") pod "network-check-target-jts5b" (UID: "b2e7eee0-e2b6-4b05-8977-448f597db52e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:32:37.059106 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:37.059069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:37.059106 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:37.059108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:37.059323 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:37.059209    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:37.059383 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:37.059331    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:38.059481 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:38.059447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:38.059991 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:38.059558    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:39.059152 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:39.059118    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:39.059331 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:39.059125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:39.059331 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:39.059251    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:39.059331 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:39.059315    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:39.288684 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:39.288615    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f" containerID="8629c5bcaaf372bb945bfdb16e168fe7726b47c78e30fe79fa8465f8ad488f92" exitCode=0
Jul 24 14:32:39.289224 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:39.288699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerDied","Data":"8629c5bcaaf372bb945bfdb16e168fe7726b47c78e30fe79fa8465f8ad488f92"}
Jul 24 14:32:40.059529 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:40.059494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:40.059740 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:40.059640    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:40.294613 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:40.294575    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f" containerID="5b7cdd090be352448077dd1dff3003351f524e36cec3be1611dcf9c831d84aa6" exitCode=0
Jul 24 14:32:40.295087 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:40.294653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerDied","Data":"5b7cdd090be352448077dd1dff3003351f524e36cec3be1611dcf9c831d84aa6"}
Jul 24 14:32:41.058904 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:41.058865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:41.059101 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:41.058864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:41.059101 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:41.059000    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:41.059222 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:41.059096    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:41.300478 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:41.300447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" event={"ID":"6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f","Type":"ContainerStarted","Data":"8d014aa64eccf3c5361772ae18b485354a81e64a489641556e2df1f3e9e9bb84"}
Jul 24 14:32:41.325135 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:41.325050    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gvtlt" podStartSLOduration=8.760509364 podStartE2EDuration="38.325031064s" totalImagesPullingTime="29.5645217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:41.324215294 +0000 UTC m=+38.676060479" watchObservedRunningTime="2026-07-24 14:32:41.325031064 +0000 UTC m=+38.676876249"
Jul 24 14:32:42.059201 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:42.059169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:42.059361 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:42.059275    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:43.059990 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:43.059965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:43.060355 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:43.060057    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:43.060355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:43.060104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:43.060355 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:43.060215    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:44.058816 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:44.058769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:44.059014 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:44.058925    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:45.059129 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:45.059091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:45.059129 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:45.059091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:45.059625 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:45.059269    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:45.059625 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:45.059357    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:46.059104 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:46.059071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:46.059252 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:46.059185    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:47.058900 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:47.058866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:47.059091 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:47.058970    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:47.059091 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:47.059029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:47.059206 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:47.059142    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:48.059170 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:48.059137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:48.059616 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:48.059248    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:49.059510 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:49.059480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:49.059921 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:49.059583    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:49.059921 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:49.059661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:49.059921 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:49.059774    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:50.059475 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:50.059441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:50.059647 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:50.059551    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:51.058932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:51.058894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:51.059106 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:51.058897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:51.059106 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:51.059020    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:51.059106 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:51.059077    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:52.058909 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:52.058873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:52.059287 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:52.058983    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:53.060420 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:53.060387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:53.060830 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:53.060486    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:53.060830 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:53.060564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:53.060830 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:53.060657    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:54.059517 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:54.059479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:54.059718 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:54.059632    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sfvd7" podUID="24e3cf1b-bab5-4b34-b77b-715ed53a01d9"
Jul 24 14:32:55.058986 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.058952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:55.059453 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.058959    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:55.059453 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:55.059048    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jts5b" podUID="b2e7eee0-e2b6-4b05-8977-448f597db52e"
Jul 24 14:32:55.059453 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:32:55.059118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt4ch" podUID="05ffa7a9-abf2-43ac-b9ee-499a0a5d095e"
Jul 24 14:32:55.548738 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.548710    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-168.ec2.internal" event="NodeReady"
Jul 24 14:32:55.548919 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.548850    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 14:32:55.617958 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.617922    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c69cb9868-64k4h"]
Jul 24 14:32:55.632769 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.632744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.639473 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.639022    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 14:32:55.639473 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.639004    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 14:32:55.639473 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.639431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 14:32:55.640254 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.640217    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wrlfw"]
Jul 24 14:32:55.640420 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.640402    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2hm46\""
Jul 24 14:32:55.648387 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.648369    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 14:32:55.657763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb68225-2a5c-472c-8c21-89f07a1422b0-registry-certificates\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.657897 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb68225-2a5c-472c-8c21-89f07a1422b0-trusted-ca\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.657897 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8x4j\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-kube-api-access-m8x4j\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.657897 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb68225-2a5c-472c-8c21-89f07a1422b0-ca-trust-extracted\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.658052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-bound-sa-token\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.658052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb68225-2a5c-472c-8c21-89f07a1422b0-image-registry-private-configuration\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.658052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.657998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-registry-tls\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.658052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.658040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb68225-2a5c-472c-8c21-89f07a1422b0-installation-pull-secrets\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.662493 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.662475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c69cb9868-64k4h"]
Jul 24 14:32:55.662570 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.662560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.664264 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.664244    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xxg4z"]
Jul 24 14:32:55.670157 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.670139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 14:32:55.670355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.670342    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 14:32:55.670429 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.670362    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lb5b6\""
Jul 24 14:32:55.676008 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.675988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 14:32:55.686665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.686646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wrlfw"]
Jul 24 14:32:55.686749 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.686735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.690716 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.690691    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 14:32:55.690833 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.690744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7vj4\""
Jul 24 14:32:55.690833 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.690783    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 14:32:55.690833 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.690813    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 14:32:55.691272 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.691256    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 14:32:55.702929 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.702909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxg4z"]
Jul 24 14:32:55.752283 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.752253    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r54nl"]
Jul 24 14:32:55.758787 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb68225-2a5c-472c-8c21-89f07a1422b0-image-registry-private-configuration\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.758787 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-registry-tls\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.758949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4284\" (UniqueName: \"kubernetes.io/projected/f6742722-db63-4f27-bbc6-1f9597e55c99-kube-api-access-z4284\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.758949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb68225-2a5c-472c-8c21-89f07a1422b0-installation-pull-secrets\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.758949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb68225-2a5c-472c-8c21-89f07a1422b0-registry-certificates\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.758949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb68225-2a5c-472c-8c21-89f07a1422b0-trusted-ca\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.759097 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6742722-db63-4f27-bbc6-1f9597e55c99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.759097 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.758984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6742722-db63-4f27-bbc6-1f9597e55c99-crio-socket\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.759097 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8x4j\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-kube-api-access-m8x4j\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.759216 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d18571c9-c1df-447d-98ac-cb7f303e5201-cert\") pod \"ingress-canary-wrlfw\" (UID: \"d18571c9-c1df-447d-98ac-cb7f303e5201\") " pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.759269 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6742722-db63-4f27-bbc6-1f9597e55c99-data-volume\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.759325 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb68225-2a5c-472c-8c21-89f07a1422b0-ca-trust-extracted\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.759325 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6742722-db63-4f27-bbc6-1f9597e55c99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.759440 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-bound-sa-token\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.759440 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmxzz\" (UniqueName: \"kubernetes.io/projected/d18571c9-c1df-447d-98ac-cb7f303e5201-kube-api-access-nmxzz\") pod \"ingress-canary-wrlfw\" (UID: \"d18571c9-c1df-447d-98ac-cb7f303e5201\") " pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.759658 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb68225-2a5c-472c-8c21-89f07a1422b0-ca-trust-extracted\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.759978 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb68225-2a5c-472c-8c21-89f07a1422b0-trusted-ca\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.760083 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.759984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb68225-2a5c-472c-8c21-89f07a1422b0-registry-certificates\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.762776 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.762755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-registry-tls\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.762894 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.762855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb68225-2a5c-472c-8c21-89f07a1422b0-installation-pull-secrets\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.762894 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.762872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb68225-2a5c-472c-8c21-89f07a1422b0-image-registry-private-configuration\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.768799 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.768769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.773754 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.773735    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 14:32:55.774844 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.774824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r54nl"]
Jul 24 14:32:55.776063 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.776046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 14:32:55.776155 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.776120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m2jtv\""
Jul 24 14:32:55.782455 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.782434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-bound-sa-token\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.782836 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.782819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8x4j\" (UniqueName: \"kubernetes.io/projected/cdb68225-2a5c-472c-8c21-89f07a1422b0-kube-api-access-m8x4j\") pod \"image-registry-6c69cb9868-64k4h\" (UID: \"cdb68225-2a5c-472c-8c21-89f07a1422b0\") " pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.860273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4284\" (UniqueName: \"kubernetes.io/projected/f6742722-db63-4f27-bbc6-1f9597e55c99-kube-api-access-z4284\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-metrics-tls\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.860273 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwssg\" (UniqueName: \"kubernetes.io/projected/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-kube-api-access-rwssg\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6742722-db63-4f27-bbc6-1f9597e55c99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6742722-db63-4f27-bbc6-1f9597e55c99-crio-socket\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d18571c9-c1df-447d-98ac-cb7f303e5201-cert\") pod \"ingress-canary-wrlfw\" (UID: \"d18571c9-c1df-447d-98ac-cb7f303e5201\") " pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-config-volume\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6742722-db63-4f27-bbc6-1f9597e55c99-data-volume\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-tmp-dir\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6742722-db63-4f27-bbc6-1f9597e55c99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmxzz\" (UniqueName: \"kubernetes.io/projected/d18571c9-c1df-447d-98ac-cb7f303e5201-kube-api-access-nmxzz\") pod \"ingress-canary-wrlfw\" (UID: \"d18571c9-c1df-447d-98ac-cb7f303e5201\") " pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.860542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6742722-db63-4f27-bbc6-1f9597e55c99-crio-socket\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860845 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6742722-db63-4f27-bbc6-1f9597e55c99-data-volume\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.860966 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.860950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6742722-db63-4f27-bbc6-1f9597e55c99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.862573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.862554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6742722-db63-4f27-bbc6-1f9597e55c99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.862763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.862747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d18571c9-c1df-447d-98ac-cb7f303e5201-cert\") pod \"ingress-canary-wrlfw\" (UID: \"d18571c9-c1df-447d-98ac-cb7f303e5201\") " pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.880126 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.880101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmxzz\" (UniqueName: \"kubernetes.io/projected/d18571c9-c1df-447d-98ac-cb7f303e5201-kube-api-access-nmxzz\") pod \"ingress-canary-wrlfw\" (UID: \"d18571c9-c1df-447d-98ac-cb7f303e5201\") " pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.880883 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.880864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4284\" (UniqueName: \"kubernetes.io/projected/f6742722-db63-4f27-bbc6-1f9597e55c99-kube-api-access-z4284\") pod \"insights-runtime-extractor-xxg4z\" (UID: \"f6742722-db63-4f27-bbc6-1f9597e55c99\") " pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:55.943200 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.943166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:55.961594 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.961561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-metrics-tls\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.961750 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.961618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwssg\" (UniqueName: \"kubernetes.io/projected/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-kube-api-access-rwssg\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.961750 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.961652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-config-volume\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.961750 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.961672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-tmp-dir\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.962046 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.962030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-tmp-dir\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.962246 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.962227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-config-volume\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.963859 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.963841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-metrics-tls\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.970858 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.970839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wrlfw"
Jul 24 14:32:55.971499 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.971484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwssg\" (UniqueName: \"kubernetes.io/projected/d73b1034-66bf-4881-a3f4-b89ba2f3c5ee-kube-api-access-rwssg\") pod \"dns-default-r54nl\" (UID: \"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee\") " pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:55.994600 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:55.994576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxg4z"
Jul 24 14:32:56.058738 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.058702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:32:56.063557 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.063529    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:32:56.064021 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.063567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tpbrb\""
Jul 24 14:32:56.083556 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.079328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r54nl"
Jul 24 14:32:56.198217 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.198120    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxg4z"]
Jul 24 14:32:56.218259 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.218147    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c69cb9868-64k4h"]
Jul 24 14:32:56.220589 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:56.220549    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb68225_2a5c_472c_8c21_89f07a1422b0.slice/crio-0451bb7eeb150d78da588bfe0ba275d263890d258b754f5be54311faac855e4d WatchSource:0}: Error finding container 0451bb7eeb150d78da588bfe0ba275d263890d258b754f5be54311faac855e4d: Status 404 returned error can't find the container with id 0451bb7eeb150d78da588bfe0ba275d263890d258b754f5be54311faac855e4d
Jul 24 14:32:56.255046 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.255013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r54nl"]
Jul 24 14:32:56.257978 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:56.257952    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73b1034_66bf_4881_a3f4_b89ba2f3c5ee.slice/crio-9f2f3f74bf62bfe5709ddc90f130249856484cb8082113538fcb07a064e1bfb7 WatchSource:0}: Error finding container 9f2f3f74bf62bfe5709ddc90f130249856484cb8082113538fcb07a064e1bfb7: Status 404 returned error can't find the container with id 9f2f3f74bf62bfe5709ddc90f130249856484cb8082113538fcb07a064e1bfb7
Jul 24 14:32:56.332951 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.332914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r54nl" event={"ID":"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee","Type":"ContainerStarted","Data":"9f2f3f74bf62bfe5709ddc90f130249856484cb8082113538fcb07a064e1bfb7"}
Jul 24 14:32:56.333971 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.333946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxg4z" event={"ID":"f6742722-db63-4f27-bbc6-1f9597e55c99","Type":"ContainerStarted","Data":"c720d79a27fe699bc1282c84f10ed508ad04f46d98354e04b19d85b106bf5709"}
Jul 24 14:32:56.334959 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.334938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h" event={"ID":"cdb68225-2a5c-472c-8c21-89f07a1422b0","Type":"ContainerStarted","Data":"0451bb7eeb150d78da588bfe0ba275d263890d258b754f5be54311faac855e4d"}
Jul 24 14:32:56.434516 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:56.434485    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wrlfw"]
Jul 24 14:32:56.439047 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:32:56.439018    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18571c9_c1df_447d_98ac_cb7f303e5201.slice/crio-f5a2bf5ad5caeae80775d8241cb063b6204b1acc21ef9d4b2369b66dbbc117fd WatchSource:0}: Error finding container f5a2bf5ad5caeae80775d8241cb063b6204b1acc21ef9d4b2369b66dbbc117fd: Status 404 returned error can't find the container with id f5a2bf5ad5caeae80775d8241cb063b6204b1acc21ef9d4b2369b66dbbc117fd
Jul 24 14:32:57.059517 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.059480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:32:57.059833 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.059528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:32:57.064194 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.063104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:32:57.064194 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.063352    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:32:57.064194 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.063567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:32:57.064194 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.063763    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljg7j\""
Jul 24 14:32:57.339727 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.339640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h" event={"ID":"cdb68225-2a5c-472c-8c21-89f07a1422b0","Type":"ContainerStarted","Data":"e0f4d40ba52923c5f8a90e656a7b197ae4e1dd9a798905883a40c43064220b1b"}
Jul 24 14:32:57.340478 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.340417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:32:57.342407 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.342353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wrlfw" event={"ID":"d18571c9-c1df-447d-98ac-cb7f303e5201","Type":"ContainerStarted","Data":"f5a2bf5ad5caeae80775d8241cb063b6204b1acc21ef9d4b2369b66dbbc117fd"}
Jul 24 14:32:57.366665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:32:57.366250    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h" podStartSLOduration=2.366229406 podStartE2EDuration="2.366229406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:57.36470592 +0000 UTC m=+54.716551128" watchObservedRunningTime="2026-07-24 14:32:57.366229406 +0000 UTC m=+54.718074594"
Jul 24 14:33:01.224877 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.224841    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-d6jwc"]
Jul 24 14:33:01.231565 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.231546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:01.234440 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.234394    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j4xng\""
Jul 24 14:33:01.234578 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.234548    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 14:33:01.234806 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.234778    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 14:33:01.240002 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.239962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-d6jwc"]
Jul 24 14:33:01.308544 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.308514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjpz\" (UniqueName: \"kubernetes.io/projected/7e28f646-85c6-4d7c-b441-33feb45ce286-kube-api-access-ppjpz\") pod \"downloads-7c97dc4555-d6jwc\" (UID: \"7e28f646-85c6-4d7c-b441-33feb45ce286\") " pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:01.409945 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.409903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjpz\" (UniqueName: \"kubernetes.io/projected/7e28f646-85c6-4d7c-b441-33feb45ce286-kube-api-access-ppjpz\") pod \"downloads-7c97dc4555-d6jwc\" (UID: \"7e28f646-85c6-4d7c-b441-33feb45ce286\") " pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:01.418401 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.418376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjpz\" (UniqueName: \"kubernetes.io/projected/7e28f646-85c6-4d7c-b441-33feb45ce286-kube-api-access-ppjpz\") pod \"downloads-7c97dc4555-d6jwc\" (UID: \"7e28f646-85c6-4d7c-b441-33feb45ce286\") " pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:01.540247 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:01.540159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:02.055471 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.055434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-d6jwc"]
Jul 24 14:33:02.057194 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:02.057163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e28f646_85c6_4d7c_b441_33feb45ce286.slice/crio-0e808ce55641602d9dbd2afc03799bab2b3fae2b3003b415cdd62722677eb6cc WatchSource:0}: Error finding container 0e808ce55641602d9dbd2afc03799bab2b3fae2b3003b415cdd62722677eb6cc: Status 404 returned error can't find the container with id 0e808ce55641602d9dbd2afc03799bab2b3fae2b3003b415cdd62722677eb6cc
Jul 24 14:33:02.361381 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.361340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wrlfw" event={"ID":"d18571c9-c1df-447d-98ac-cb7f303e5201","Type":"ContainerStarted","Data":"12e23cebce3a5e56d11f20ace51d00221c86deb8b48a9a905a7afcf7ddb44b3b"}
Jul 24 14:33:02.362583 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.362552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-d6jwc" event={"ID":"7e28f646-85c6-4d7c-b441-33feb45ce286","Type":"ContainerStarted","Data":"0e808ce55641602d9dbd2afc03799bab2b3fae2b3003b415cdd62722677eb6cc"}
Jul 24 14:33:02.364180 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.364159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r54nl" event={"ID":"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee","Type":"ContainerStarted","Data":"4fb1224dfffaa730b6ed5fb20f7abb5fc3b96e4bc4df3b1912e839da1ecfa79b"}
Jul 24 14:33:02.364277 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.364196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r54nl" event={"ID":"d73b1034-66bf-4881-a3f4-b89ba2f3c5ee","Type":"ContainerStarted","Data":"07707c9b50049be36ec006a9f18b59bc6b0929bc4a6baef79751deb3faac28ce"}
Jul 24 14:33:02.364277 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.364232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r54nl"
Jul 24 14:33:02.365701 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.365678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxg4z" event={"ID":"f6742722-db63-4f27-bbc6-1f9597e55c99","Type":"ContainerStarted","Data":"021d6cfe6d3dc822252f77d7f68240661b0fd62147e9af644a008cc3891ab47e"}
Jul 24 14:33:02.383264 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.383222    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wrlfw" podStartSLOduration=1.924652858 podStartE2EDuration="7.383205617s" totalImagesPullingTime="5.458552759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:02.382426284 +0000 UTC m=+59.734271469" watchObservedRunningTime="2026-07-24 14:33:02.383205617 +0000 UTC m=+59.735050829"
Jul 24 14:33:02.405891 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:02.405829    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r54nl" podStartSLOduration=1.768040306 podStartE2EDuration="7.405771017s" totalImagesPullingTime="5.637730711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:02.403873855 +0000 UTC m=+59.755719041" watchObservedRunningTime="2026-07-24 14:33:02.405771017 +0000 UTC m=+59.757616203"
Jul 24 14:33:03.282617 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:03.282403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nxmw"
Jul 24 14:33:06.380594 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:06.380514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxg4z" event={"ID":"f6742722-db63-4f27-bbc6-1f9597e55c99","Type":"ContainerStarted","Data":"42a1f3c39e221f72d2519c425aff0be7c7bc1280629df8a2c2e76f44e3fb974f"}
Jul 24 14:33:08.973403 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.973369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:33:08.973403 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.973417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:33:08.973950 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.973474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:33:08.976219 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.976193    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:33:08.977000 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.976976    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:33:08.977159 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.976978    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:33:08.986463 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.986294    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:33:08.986760 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.986737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05ffa7a9-abf2-43ac-b9ee-499a0a5d095e-original-pull-secret\") pod \"global-pull-secret-syncer-xt4ch\" (UID: \"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e\") " pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:33:08.986850 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.986778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24e3cf1b-bab5-4b34-b77b-715ed53a01d9-metrics-certs\") pod \"network-metrics-daemon-sfvd7\" (UID: \"24e3cf1b-bab5-4b34-b77b-715ed53a01d9\") " pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:33:08.996849 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:08.996822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv7c6\" (UniqueName: \"kubernetes.io/projected/b2e7eee0-e2b6-4b05-8977-448f597db52e-kube-api-access-lv7c6\") pod \"network-check-target-jts5b\" (UID: \"b2e7eee0-e2b6-4b05-8977-448f597db52e\") " pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:33:09.077673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:09.077639    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt4ch"
Jul 24 14:33:09.093301 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:09.093181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljg7j\""
Jul 24 14:33:09.100502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:09.100475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:33:09.276022 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:09.275944    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tpbrb\""
Jul 24 14:33:09.284241 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:09.284214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sfvd7"
Jul 24 14:33:10.096233 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.096119    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xt4ch"]
Jul 24 14:33:10.100391 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:10.100349    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ffa7a9_abf2_43ac_b9ee_499a0a5d095e.slice/crio-324cda6332c16a23376df2f6701de83be68edaf15b85e369f742483b4204bba6 WatchSource:0}: Error finding container 324cda6332c16a23376df2f6701de83be68edaf15b85e369f742483b4204bba6: Status 404 returned error can't find the container with id 324cda6332c16a23376df2f6701de83be68edaf15b85e369f742483b4204bba6
Jul 24 14:33:10.114599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.114574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jts5b"]
Jul 24 14:33:10.117897 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.117829    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sfvd7"]
Jul 24 14:33:10.118231 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:10.118202    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e7eee0_e2b6_4b05_8977_448f597db52e.slice/crio-a541c72ddd70c11cdd10709ff77409c0bcb0ad6a6dd4d64a1ebdcc249603c37a WatchSource:0}: Error finding container a541c72ddd70c11cdd10709ff77409c0bcb0ad6a6dd4d64a1ebdcc249603c37a: Status 404 returned error can't find the container with id a541c72ddd70c11cdd10709ff77409c0bcb0ad6a6dd4d64a1ebdcc249603c37a
Jul 24 14:33:10.121424 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:10.121403    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e3cf1b_bab5_4b34_b77b_715ed53a01d9.slice/crio-aa060204078a9b6474162681b8676eaa2b549e30d54192589164d03578160ef1 WatchSource:0}: Error finding container aa060204078a9b6474162681b8676eaa2b549e30d54192589164d03578160ef1: Status 404 returned error can't find the container with id aa060204078a9b6474162681b8676eaa2b549e30d54192589164d03578160ef1
Jul 24 14:33:10.396665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.396585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xt4ch" event={"ID":"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e","Type":"ContainerStarted","Data":"324cda6332c16a23376df2f6701de83be68edaf15b85e369f742483b4204bba6"}
Jul 24 14:33:10.398862 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.398835    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxg4z" event={"ID":"f6742722-db63-4f27-bbc6-1f9597e55c99","Type":"ContainerStarted","Data":"5076edad41fd0c52fa949781fd33d077803e8f9f7eeadc4947607dc192791deb"}
Jul 24 14:33:10.400196 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.400175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jts5b" event={"ID":"b2e7eee0-e2b6-4b05-8977-448f597db52e","Type":"ContainerStarted","Data":"a541c72ddd70c11cdd10709ff77409c0bcb0ad6a6dd4d64a1ebdcc249603c37a"}
Jul 24 14:33:10.401205 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.401183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sfvd7" event={"ID":"24e3cf1b-bab5-4b34-b77b-715ed53a01d9","Type":"ContainerStarted","Data":"aa060204078a9b6474162681b8676eaa2b549e30d54192589164d03578160ef1"}
Jul 24 14:33:10.418449 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.418403    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xxg4z" podStartSLOduration=1.77110858 podStartE2EDuration="15.418389153s" totalImagesPullingTime="13.647280573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:10.417596771 +0000 UTC m=+67.769441956" watchObservedRunningTime="2026-07-24 14:33:10.418389153 +0000 UTC m=+67.770234338"
Jul 24 14:33:10.735824 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.735778    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cfc858bcc-f5qwh"]
Jul 24 14:33:10.754852 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.754821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfc858bcc-f5qwh"]
Jul 24 14:33:10.755006 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.754951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.758986 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.758958    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 14:33:10.759458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.759433    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 14:33:10.759691 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.759670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fkhlz\""
Jul 24 14:33:10.759874 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.759858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 14:33:10.759960 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.759943    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 14:33:10.760091 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.760075    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 14:33:10.890368 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.890097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-serving-cert\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.890368 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.890143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-service-ca\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.890368 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.890169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krmkt\" (UniqueName: \"kubernetes.io/projected/77f11e0a-1467-45a1-8de7-64f98d14e9b6-kube-api-access-krmkt\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.890368 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.890194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-oauth-config\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.890368 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.890233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-oauth-serving-cert\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.890368 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.890273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-config\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.991138 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.991054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-config\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.991138 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.991124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-serving-cert\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.991354 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.991150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-service-ca\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.991354 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.991175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krmkt\" (UniqueName: \"kubernetes.io/projected/77f11e0a-1467-45a1-8de7-64f98d14e9b6-kube-api-access-krmkt\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.991354 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.991203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-oauth-config\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.991354 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.991243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-oauth-serving-cert\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.992140 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.992091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-oauth-serving-cert\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.992278 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.992254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-config\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.992353 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.992254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-service-ca\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.994518 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.994492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-serving-cert\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:10.996496 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:10.996467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-oauth-config\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:11.000887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:11.000847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krmkt\" (UniqueName: \"kubernetes.io/projected/77f11e0a-1467-45a1-8de7-64f98d14e9b6-kube-api-access-krmkt\") pod \"console-5cfc858bcc-f5qwh\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") " pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:11.070563 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:11.070270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:11.525619 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:11.525584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfc858bcc-f5qwh"]
Jul 24 14:33:11.631545 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:11.631470    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f11e0a_1467_45a1_8de7_64f98d14e9b6.slice/crio-d9d6f87af6e5cf81ef519dede712b81e621bee15df412f79ef0e3e19541e32a4 WatchSource:0}: Error finding container d9d6f87af6e5cf81ef519dede712b81e621bee15df412f79ef0e3e19541e32a4: Status 404 returned error can't find the container with id d9d6f87af6e5cf81ef519dede712b81e621bee15df412f79ef0e3e19541e32a4
Jul 24 14:33:12.371777 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:12.371735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r54nl"
Jul 24 14:33:12.417435 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:12.417284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfc858bcc-f5qwh" event={"ID":"77f11e0a-1467-45a1-8de7-64f98d14e9b6","Type":"ContainerStarted","Data":"d9d6f87af6e5cf81ef519dede712b81e621bee15df412f79ef0e3e19541e32a4"}
Jul 24 14:33:12.421427 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:12.420663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sfvd7" event={"ID":"24e3cf1b-bab5-4b34-b77b-715ed53a01d9","Type":"ContainerStarted","Data":"cc03beebab218c3c816e2c750993ee9425e3b6c94e9dcdd64bb890b34110ae90"}
Jul 24 14:33:12.421427 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:12.420716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sfvd7" event={"ID":"24e3cf1b-bab5-4b34-b77b-715ed53a01d9","Type":"ContainerStarted","Data":"9672ce8a7060876662c3495d3a5fde1218c06ec4f052ca97dca9d7a0d4c06420"}
Jul 24 14:33:14.275316 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.275250    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sfvd7" podStartSLOduration=69.748149272 podStartE2EDuration="1m11.275233386s" totalImagesPullingTime="1.527084114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:12.441227458 +0000 UTC m=+69.793072644" watchObservedRunningTime="2026-07-24 14:33:14.275233386 +0000 UTC m=+71.627078570"
Jul 24 14:33:14.276786 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.276525    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"]
Jul 24 14:33:14.279922 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.279895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.282335 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.282317    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 14:33:14.282455 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.282318    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 14:33:14.283423 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.283348    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 14:33:14.283423 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.283356    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 14:33:14.284065 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.284040    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mfh7v\""
Jul 24 14:33:14.284168 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.284065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 14:33:14.288091 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.288071    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"]
Jul 24 14:33:14.291053 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.291035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pvr4k"]
Jul 24 14:33:14.291165 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.291151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.294262 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.294243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.295188 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.295165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 14:33:14.295262 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.295209    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 14:33:14.295504 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.295481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8zpd4\""
Jul 24 14:33:14.295572 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.295558    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 14:33:14.297118 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.296942    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r2rmr\""
Jul 24 14:33:14.297118 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.296989    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 14:33:14.297118 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.297077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 14:33:14.297497 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.297470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 14:33:14.298575 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.298558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"]
Jul 24 14:33:14.307095 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.306878    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"]
Jul 24 14:33:14.424450 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f44df95a-2748-4ffb-a526-569b34a58f9f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.424450 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f44df95a-2748-4ffb-a526-569b34a58f9f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.424450 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.424450 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llqmj\" (UniqueName: \"kubernetes.io/projected/c060a4b3-be4b-4938-982b-c864dea5c418-kube-api-access-llqmj\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvw7d\" (UniqueName: \"kubernetes.io/projected/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-api-access-qvw7d\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f44df95a-2748-4ffb-a526-569b34a58f9f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/27d95595-36ac-40a3-ac84-9ffbb8b30c91-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-textfile\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c060a4b3-be4b-4938-982b-c864dea5c418-metrics-client-ca\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.424763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-tls\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d95595-36ac-40a3-ac84-9ffbb8b30c91-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-root\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-sys\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.424949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h26x\" (UniqueName: \"kubernetes.io/projected/f44df95a-2748-4ffb-a526-569b34a58f9f-kube-api-access-5h26x\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.425014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-wtmp\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.425093 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.425037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526205 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-wtmp\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526205 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526205 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f44df95a-2748-4ffb-a526-569b34a58f9f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f44df95a-2748-4ffb-a526-569b34a58f9f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llqmj\" (UniqueName: \"kubernetes.io/projected/c060a4b3-be4b-4938-982b-c864dea5c418-kube-api-access-llqmj\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvw7d\" (UniqueName: \"kubernetes.io/projected/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-api-access-qvw7d\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-wtmp\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f44df95a-2748-4ffb-a526-569b34a58f9f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/27d95595-36ac-40a3-ac84-9ffbb8b30c91-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-textfile\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c060a4b3-be4b-4938-982b-c864dea5c418-metrics-client-ca\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-tls\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d95595-36ac-40a3-ac84-9ffbb8b30c91-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-root\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-sys\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.526968 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.526714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h26x\" (UniqueName: \"kubernetes.io/projected/f44df95a-2748-4ffb-a526-569b34a58f9f-kube-api-access-5h26x\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.527443 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.527009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.527443 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.527076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-root\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.527443 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.527253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f44df95a-2748-4ffb-a526-569b34a58f9f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.527763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.527740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d95595-36ac-40a3-ac84-9ffbb8b30c91-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.527863 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.527820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-textfile\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.527920 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.527883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c060a4b3-be4b-4938-982b-c864dea5c418-sys\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.528314 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.528251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c060a4b3-be4b-4938-982b-c864dea5c418-metrics-client-ca\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.529017 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.528508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/27d95595-36ac-40a3-ac84-9ffbb8b30c91-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.529017 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.528976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.529899 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.529855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-tls\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.530080 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.530057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.530885 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.530855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c060a4b3-be4b-4938-982b-c864dea5c418-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.530978 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.530909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f44df95a-2748-4ffb-a526-569b34a58f9f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.531705 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.531681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.532194 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.532162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f44df95a-2748-4ffb-a526-569b34a58f9f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.535502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.535459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h26x\" (UniqueName: \"kubernetes.io/projected/f44df95a-2748-4ffb-a526-569b34a58f9f-kube-api-access-5h26x\") pod \"openshift-state-metrics-b8f49f5c6-66dhd\" (UID: \"f44df95a-2748-4ffb-a526-569b34a58f9f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.535597 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.535524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvw7d\" (UniqueName: \"kubernetes.io/projected/27d95595-36ac-40a3-ac84-9ffbb8b30c91-kube-api-access-qvw7d\") pod \"kube-state-metrics-56d9f944b4-5n8fr\" (UID: \"27d95595-36ac-40a3-ac84-9ffbb8b30c91\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.536917 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.536884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llqmj\" (UniqueName: \"kubernetes.io/projected/c060a4b3-be4b-4938-982b-c864dea5c418-kube-api-access-llqmj\") pod \"node-exporter-pvr4k\" (UID: \"c060a4b3-be4b-4938-982b-c864dea5c418\") " pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:14.591507 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.591475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"
Jul 24 14:33:14.603041 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.603016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"
Jul 24 14:33:14.609732 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:14.609711    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvr4k"
Jul 24 14:33:15.948008 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:15.947955    2580 patch_prober.go:28] interesting pod/image-registry-6c69cb9868-64k4h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 14:33:15.948492 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:15.948046    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h" podUID="cdb68225-2a5c-472c-8c21-89f07a1422b0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 14:33:18.604221 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.604186    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7446c74b59-vxbp5"]
Jul 24 14:33:18.695541 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.695499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7446c74b59-vxbp5"]
Jul 24 14:33:18.695724 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.695633    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.698351 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.698324    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 14:33:18.698631 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.698556    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 14:33:18.699439 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.699317    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 14:33:18.699439 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.699328    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 14:33:18.699439 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.699328    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7gmlz\""
Jul 24 14:33:18.699771 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.699747    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3bk418gidn8nm\""
Jul 24 14:33:18.764006 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.763967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-secret-metrics-server-client-certs\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.764187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.764034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1861b07b-42c0-44ca-9629-0dadd81ac0b2-audit-log\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.764187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.764117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-secret-metrics-server-tls\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.764187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.764174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1861b07b-42c0-44ca-9629-0dadd81ac0b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.764352 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.764237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-client-ca-bundle\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.764352 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.764291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vzn\" (UniqueName: \"kubernetes.io/projected/1861b07b-42c0-44ca-9629-0dadd81ac0b2-kube-api-access-p5vzn\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.764352 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.764335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1861b07b-42c0-44ca-9629-0dadd81ac0b2-metrics-server-audit-profiles\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865451 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-secret-metrics-server-client-certs\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865451 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1861b07b-42c0-44ca-9629-0dadd81ac0b2-audit-log\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865451 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-secret-metrics-server-tls\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1861b07b-42c0-44ca-9629-0dadd81ac0b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-client-ca-bundle\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vzn\" (UniqueName: \"kubernetes.io/projected/1861b07b-42c0-44ca-9629-0dadd81ac0b2-kube-api-access-p5vzn\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1861b07b-42c0-44ca-9629-0dadd81ac0b2-metrics-server-audit-profiles\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.865997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.865975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1861b07b-42c0-44ca-9629-0dadd81ac0b2-audit-log\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.866435 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.866407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1861b07b-42c0-44ca-9629-0dadd81ac0b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.866572 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.866553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1861b07b-42c0-44ca-9629-0dadd81ac0b2-metrics-server-audit-profiles\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.868256 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.868231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-client-ca-bundle\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.868759 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.868719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-secret-metrics-server-client-certs\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.868886 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.868864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1861b07b-42c0-44ca-9629-0dadd81ac0b2-secret-metrics-server-tls\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:18.874023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:18.873999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vzn\" (UniqueName: \"kubernetes.io/projected/1861b07b-42c0-44ca-9629-0dadd81ac0b2-kube-api-access-p5vzn\") pod \"metrics-server-7446c74b59-vxbp5\" (UID: \"1861b07b-42c0-44ca-9629-0dadd81ac0b2\") " pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:19.007556 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.007512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:19.340935 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.340885    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cdbbcd546-dhhnr"]
Jul 24 14:33:19.410024 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.409916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c69cb9868-64k4h"
Jul 24 14:33:19.410024 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.409973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdbbcd546-dhhnr"]
Jul 24 14:33:19.410261 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.410158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.422080 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.422050    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 14:33:19.572764 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.572720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-oauth-config\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.572970 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.572781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-serving-cert\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.572970 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.572827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-oauth-serving-cert\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.572970 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.572890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-service-ca\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.573136 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.573025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-trusted-ca-bundle\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.573136 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.573086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jcp\" (UniqueName: \"kubernetes.io/projected/17462efa-3d26-4339-b002-cfc4b094b29b-kube-api-access-f2jcp\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.573253 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.573227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-console-config\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674072 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-trusted-ca-bundle\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jcp\" (UniqueName: \"kubernetes.io/projected/17462efa-3d26-4339-b002-cfc4b094b29b-kube-api-access-f2jcp\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-console-config\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-oauth-config\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-serving-cert\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-oauth-serving-cert\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-service-ca\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.674953 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.674925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-console-config\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.675039 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.675010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-trusted-ca-bundle\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.675151 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.675123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-service-ca\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.675151 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.675123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-oauth-serving-cert\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.676961 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.676939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-oauth-config\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.677279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.677260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-serving-cert\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.683573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.683547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jcp\" (UniqueName: \"kubernetes.io/projected/17462efa-3d26-4339-b002-cfc4b094b29b-kube-api-access-f2jcp\") pod \"console-7cdbbcd546-dhhnr\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") " pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:19.724435 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:19.724402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:24.363398 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:24.363367    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc060a4b3_be4b_4938_982b_c864dea5c418.slice/crio-e01757540762a5a6aec8c336baa6a15385eb6763b029a3b412d403379f1f3b88 WatchSource:0}: Error finding container e01757540762a5a6aec8c336baa6a15385eb6763b029a3b412d403379f1f3b88: Status 404 returned error can't find the container with id e01757540762a5a6aec8c336baa6a15385eb6763b029a3b412d403379f1f3b88
Jul 24 14:33:24.493144 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.491163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jts5b" event={"ID":"b2e7eee0-e2b6-4b05-8977-448f597db52e","Type":"ContainerStarted","Data":"3894c1f357ac0945a396cc441e5b3329acdbcc4bafcef3e8fc3892054ddbfd86"}
Jul 24 14:33:24.493144 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.492026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:33:24.503773 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.503690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvr4k" event={"ID":"c060a4b3-be4b-4938-982b-c864dea5c418","Type":"ContainerStarted","Data":"e01757540762a5a6aec8c336baa6a15385eb6763b029a3b412d403379f1f3b88"}
Jul 24 14:33:24.578572 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.578526    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jts5b" podStartSLOduration=67.348163651 podStartE2EDuration="1m21.578509961s" totalImagesPullingTime="14.23034631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:24.521908774 +0000 UTC m=+81.873753962" watchObservedRunningTime="2026-07-24 14:33:24.578509961 +0000 UTC m=+81.930355166"
Jul 24 14:33:24.579200 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.579182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd"]
Jul 24 14:33:24.583755 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:24.583699    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf44df95a_2748_4ffb_a526_569b34a58f9f.slice/crio-9670c3d0e5e4595407d67d8cdf5feef1e55d00d1aeb64d3e669b1c7d11293578 WatchSource:0}: Error finding container 9670c3d0e5e4595407d67d8cdf5feef1e55d00d1aeb64d3e669b1c7d11293578: Status 404 returned error can't find the container with id 9670c3d0e5e4595407d67d8cdf5feef1e55d00d1aeb64d3e669b1c7d11293578
Jul 24 14:33:24.589706 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.588579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7446c74b59-vxbp5"]
Jul 24 14:33:24.592137 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:24.592091    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1861b07b_42c0_44ca_9629_0dadd81ac0b2.slice/crio-481a6d810a2f2afeef2e806235df835a5e397b0fe36b70fb1d617b5655fb053b WatchSource:0}: Error finding container 481a6d810a2f2afeef2e806235df835a5e397b0fe36b70fb1d617b5655fb053b: Status 404 returned error can't find the container with id 481a6d810a2f2afeef2e806235df835a5e397b0fe36b70fb1d617b5655fb053b
Jul 24 14:33:24.597286 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.597254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr"]
Jul 24 14:33:24.603540 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:24.603471    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d95595_36ac_40a3_ac84_9ffbb8b30c91.slice/crio-802076f0e549c4858efcefaf6dbc5cf1c6345a5619a4a7a951f9f7365dc8c52c WatchSource:0}: Error finding container 802076f0e549c4858efcefaf6dbc5cf1c6345a5619a4a7a951f9f7365dc8c52c: Status 404 returned error can't find the container with id 802076f0e549c4858efcefaf6dbc5cf1c6345a5619a4a7a951f9f7365dc8c52c
Jul 24 14:33:24.632485 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:24.632448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdbbcd546-dhhnr"]
Jul 24 14:33:24.639964 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:24.639939    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17462efa_3d26_4339_b002_cfc4b094b29b.slice/crio-27e82f1d4768831d2752d93285249037d8e3104ef913e6c0dc571336827cf02e WatchSource:0}: Error finding container 27e82f1d4768831d2752d93285249037d8e3104ef913e6c0dc571336827cf02e: Status 404 returned error can't find the container with id 27e82f1d4768831d2752d93285249037d8e3104ef913e6c0dc571336827cf02e
Jul 24 14:33:25.510001 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.509865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdbbcd546-dhhnr" event={"ID":"17462efa-3d26-4339-b002-cfc4b094b29b","Type":"ContainerStarted","Data":"2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc"}
Jul 24 14:33:25.510001 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.509924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdbbcd546-dhhnr" event={"ID":"17462efa-3d26-4339-b002-cfc4b094b29b","Type":"ContainerStarted","Data":"27e82f1d4768831d2752d93285249037d8e3104ef913e6c0dc571336827cf02e"}
Jul 24 14:33:25.512138 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.511710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-d6jwc" event={"ID":"7e28f646-85c6-4d7c-b441-33feb45ce286","Type":"ContainerStarted","Data":"47c788623d5a724b95db47aa2622c9fd483bfa0c9f1c26a03cdfc784f992e3dd"}
Jul 24 14:33:25.512138 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.511819    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:25.513767 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.513706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr" event={"ID":"27d95595-36ac-40a3-ac84-9ffbb8b30c91","Type":"ContainerStarted","Data":"802076f0e549c4858efcefaf6dbc5cf1c6345a5619a4a7a951f9f7365dc8c52c"}
Jul 24 14:33:25.515065 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.515035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5" event={"ID":"1861b07b-42c0-44ca-9629-0dadd81ac0b2","Type":"ContainerStarted","Data":"481a6d810a2f2afeef2e806235df835a5e397b0fe36b70fb1d617b5655fb053b"}
Jul 24 14:33:25.516763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.516738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfc858bcc-f5qwh" event={"ID":"77f11e0a-1467-45a1-8de7-64f98d14e9b6","Type":"ContainerStarted","Data":"43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95"}
Jul 24 14:33:25.518881 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.518859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd" event={"ID":"f44df95a-2748-4ffb-a526-569b34a58f9f","Type":"ContainerStarted","Data":"c6df0c40dcac7557f609a69004079ffd0ad6ae81376b62f9be8c8945bebde76b"}
Jul 24 14:33:25.518984 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.518903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd" event={"ID":"f44df95a-2748-4ffb-a526-569b34a58f9f","Type":"ContainerStarted","Data":"208154eb765ac2ec7938575b66ea152425ef9549bc4025091d713a0c6f619fb3"}
Jul 24 14:33:25.518984 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.518923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd" event={"ID":"f44df95a-2748-4ffb-a526-569b34a58f9f","Type":"ContainerStarted","Data":"9670c3d0e5e4595407d67d8cdf5feef1e55d00d1aeb64d3e669b1c7d11293578"}
Jul 24 14:33:25.520416 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.520391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xt4ch" event={"ID":"05ffa7a9-abf2-43ac-b9ee-499a0a5d095e","Type":"ContainerStarted","Data":"ea53cd6cb06696104d8bc344597eae79aec809be3d0e809105d768eab67a2353"}
Jul 24 14:33:25.523582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.523559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-d6jwc"
Jul 24 14:33:25.529593 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.529547    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cdbbcd546-dhhnr" podStartSLOduration=6.529532833 podStartE2EDuration="6.529532833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:25.528365994 +0000 UTC m=+82.880211192" watchObservedRunningTime="2026-07-24 14:33:25.529532833 +0000 UTC m=+82.881378017"
Jul 24 14:33:25.544552 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.544487    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xt4ch" podStartSLOduration=68.295826938 podStartE2EDuration="1m22.544468331s" totalImagesPullingTime="14.248641393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:25.544216426 +0000 UTC m=+82.896061635" watchObservedRunningTime="2026-07-24 14:33:25.544468331 +0000 UTC m=+82.896313517"
Jul 24 14:33:25.562838 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.562770    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-d6jwc" podStartSLOduration=2.21730164 podStartE2EDuration="24.562748329s" totalImagesPullingTime="22.345446689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:25.561121306 +0000 UTC m=+82.912966491" watchObservedRunningTime="2026-07-24 14:33:25.562748329 +0000 UTC m=+82.914593517"
Jul 24 14:33:25.579894 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.579619    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cfc858bcc-f5qwh" podStartSLOduration=2.85954742 podStartE2EDuration="15.57959427s" totalImagesPullingTime="12.72004685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:25.57898353 +0000 UTC m=+82.930828720" watchObservedRunningTime="2026-07-24 14:33:25.57959427 +0000 UTC m=+82.931439456"
Jul 24 14:33:25.944378 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.944242    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfc858bcc-f5qwh"]
Jul 24 14:33:25.955838 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.954340    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67484c6775-tk7ff"]
Jul 24 14:33:25.973854 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.973824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67484c6775-tk7ff"]
Jul 24 14:33:25.973991 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:25.973949    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142159 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-console-config\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-oauth-serving-cert\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-trusted-ca-bundle\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-serving-cert\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nmxk\" (UniqueName: \"kubernetes.io/projected/198637bf-3289-4ed0-adfa-73a22eef4db5-kube-api-access-7nmxk\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142334 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-service-ca\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.142597 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.142346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-oauth-config\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-service-ca\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-oauth-config\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-console-config\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-oauth-serving-cert\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-trusted-ca-bundle\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-serving-cert\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.243681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nmxk\" (UniqueName: \"kubernetes.io/projected/198637bf-3289-4ed0-adfa-73a22eef4db5-kube-api-access-7nmxk\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.244910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-service-ca\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.246487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-oauth-serving-cert\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.247875 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.247100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-console-config\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.248532 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.248033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-trusted-ca-bundle\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.268187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.261157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nmxk\" (UniqueName: \"kubernetes.io/projected/198637bf-3289-4ed0-adfa-73a22eef4db5-kube-api-access-7nmxk\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.268187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.265462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-serving-cert\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.268187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.268126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-oauth-config\") pod \"console-67484c6775-tk7ff\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") " pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.292394 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.292140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:26.499612 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.499503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67484c6775-tk7ff"]
Jul 24 14:33:26.504026 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:33:26.503993    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198637bf_3289_4ed0_adfa_73a22eef4db5.slice/crio-5efd4477c366f82ca3be5839e672992ec2e3353ca330ca9897f7c39740ca6b02 WatchSource:0}: Error finding container 5efd4477c366f82ca3be5839e672992ec2e3353ca330ca9897f7c39740ca6b02: Status 404 returned error can't find the container with id 5efd4477c366f82ca3be5839e672992ec2e3353ca330ca9897f7c39740ca6b02
Jul 24 14:33:26.527402 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.526386    2580 generic.go:356] "Generic (PLEG): container finished" podID="c060a4b3-be4b-4938-982b-c864dea5c418" containerID="0160eba5b2d6bc484f54ee2d7e6c798cb7686fd55a1118a336b3e33977866cd3" exitCode=0
Jul 24 14:33:26.527402 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.526531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvr4k" event={"ID":"c060a4b3-be4b-4938-982b-c864dea5c418","Type":"ContainerDied","Data":"0160eba5b2d6bc484f54ee2d7e6c798cb7686fd55a1118a336b3e33977866cd3"}
Jul 24 14:33:26.531304 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:26.531277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67484c6775-tk7ff" event={"ID":"198637bf-3289-4ed0-adfa-73a22eef4db5","Type":"ContainerStarted","Data":"5efd4477c366f82ca3be5839e672992ec2e3353ca330ca9897f7c39740ca6b02"}
Jul 24 14:33:29.545936 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.545894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr" event={"ID":"27d95595-36ac-40a3-ac84-9ffbb8b30c91","Type":"ContainerStarted","Data":"6df935760e7c3b484f49bc5dc12a17989b4837e8ac1a017e883704528a538a30"}
Jul 24 14:33:29.546396 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.545964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr" event={"ID":"27d95595-36ac-40a3-ac84-9ffbb8b30c91","Type":"ContainerStarted","Data":"e22a6add87de86853219c259d94a4973bd0df38332cacb8a6f939d7c5abfabf9"}
Jul 24 14:33:29.546396 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.545997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr" event={"ID":"27d95595-36ac-40a3-ac84-9ffbb8b30c91","Type":"ContainerStarted","Data":"b97e7584f0d09fa86baffaa5196517649d7f89f113be8007f39569f02bd722e4"}
Jul 24 14:33:29.548089 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.548060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5" event={"ID":"1861b07b-42c0-44ca-9629-0dadd81ac0b2","Type":"ContainerStarted","Data":"d2b5a3f9154023d6fcfea1a73ade0fe80af93cf3b76090c0cb117fa7d5de11ab"}
Jul 24 14:33:29.550766 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.550741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd" event={"ID":"f44df95a-2748-4ffb-a526-569b34a58f9f","Type":"ContainerStarted","Data":"7085377ef89f0b8b3ca00a65b8b7202e4241a96207f7360011b15e4af89488ee"}
Jul 24 14:33:29.552779 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.552748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67484c6775-tk7ff" event={"ID":"198637bf-3289-4ed0-adfa-73a22eef4db5","Type":"ContainerStarted","Data":"4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f"}
Jul 24 14:33:29.555578 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.555554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvr4k" event={"ID":"c060a4b3-be4b-4938-982b-c864dea5c418","Type":"ContainerStarted","Data":"5e1f921290524c5e58f32490fc19456e33d0534866450d833524c3cbfb570f5e"}
Jul 24 14:33:29.555699 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.555592    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvr4k" event={"ID":"c060a4b3-be4b-4938-982b-c864dea5c418","Type":"ContainerStarted","Data":"7041a49fed73e74ce68f7d5c625a671654163ef586d3971b9fd25e007e9a5dcb"}
Jul 24 14:33:29.571962 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.571911    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5n8fr" podStartSLOduration=11.619048367 podStartE2EDuration="15.571897239s" totalImagesPullingTime="3.952848872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:29.569351321 +0000 UTC m=+86.921196543" watchObservedRunningTime="2026-07-24 14:33:29.571897239 +0000 UTC m=+86.923742424"
Jul 24 14:33:29.594345 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.594287    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67484c6775-tk7ff" podStartSLOduration=4.594270901 podStartE2EDuration="4.594270901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:29.593891962 +0000 UTC m=+86.945737149" watchObservedRunningTime="2026-07-24 14:33:29.594270901 +0000 UTC m=+86.946116087"
Jul 24 14:33:29.622288 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.622238    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-66dhd" podStartSLOduration=11.792736313 podStartE2EDuration="15.622224599s" totalImagesPullingTime="3.829488286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:29.621056781 +0000 UTC m=+86.972901986" watchObservedRunningTime="2026-07-24 14:33:29.622224599 +0000 UTC m=+86.974069784"
Jul 24 14:33:29.644235 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.644176    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pvr4k" podStartSLOduration=14.063271981 podStartE2EDuration="15.64416025s" totalImagesPullingTime="1.47125235s" totalInitContainerRuntime="109.635919ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:29.643125965 +0000 UTC m=+86.994971154" watchObservedRunningTime="2026-07-24 14:33:29.64416025 +0000 UTC m=+86.996005434"
Jul 24 14:33:29.663664 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.663606    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5" podStartSLOduration=7.699382651 podStartE2EDuration="11.663588833s" totalImagesPullingTime="3.964206182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:29.662213402 +0000 UTC m=+87.014058590" watchObservedRunningTime="2026-07-24 14:33:29.663588833 +0000 UTC m=+87.015434078"
Jul 24 14:33:29.725421 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.725384    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:29.725743 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.725716    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:29.731351 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:29.731327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:30.564574 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:30.564546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:33:31.071043 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:31.071009    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:36.293363 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:36.293320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:36.293761 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:36.293392    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:36.298037 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:36.298016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:36.589124 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:36.589047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:33:36.637483 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:36.637453    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdbbcd546-dhhnr"]
Jul 24 14:33:39.007897 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:39.007864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:39.008355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:39.007923    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:52.556396 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.556330    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cfc858bcc-f5qwh" podUID="77f11e0a-1467-45a1-8de7-64f98d14e9b6" containerName="console" containerID="cri-o://43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95" gracePeriod=15
Jul 24 14:33:52.796558 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.796529    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:52.891143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-serving-cert\") pod \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") "
Jul 24 14:33:52.891143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-oauth-serving-cert\") pod \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") "
Jul 24 14:33:52.891364 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krmkt\" (UniqueName: \"kubernetes.io/projected/77f11e0a-1467-45a1-8de7-64f98d14e9b6-kube-api-access-krmkt\") pod \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") "
Jul 24 14:33:52.891364 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-service-ca\") pod \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") "
Jul 24 14:33:52.891364 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891290    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-oauth-config\") pod \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") "
Jul 24 14:33:52.891364 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-config\") pod \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\" (UID: \"77f11e0a-1467-45a1-8de7-64f98d14e9b6\") "
Jul 24 14:33:52.891585 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891553    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77f11e0a-1467-45a1-8de7-64f98d14e9b6" (UID: "77f11e0a-1467-45a1-8de7-64f98d14e9b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:52.891638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "77f11e0a-1467-45a1-8de7-64f98d14e9b6" (UID: "77f11e0a-1467-45a1-8de7-64f98d14e9b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:52.891874 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.891845    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-config" (OuterVolumeSpecName: "console-config") pod "77f11e0a-1467-45a1-8de7-64f98d14e9b6" (UID: "77f11e0a-1467-45a1-8de7-64f98d14e9b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:52.893428 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.893401    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f11e0a-1467-45a1-8de7-64f98d14e9b6-kube-api-access-krmkt" (OuterVolumeSpecName: "kube-api-access-krmkt") pod "77f11e0a-1467-45a1-8de7-64f98d14e9b6" (UID: "77f11e0a-1467-45a1-8de7-64f98d14e9b6"). InnerVolumeSpecName "kube-api-access-krmkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:52.893516 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.893405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77f11e0a-1467-45a1-8de7-64f98d14e9b6" (UID: "77f11e0a-1467-45a1-8de7-64f98d14e9b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:33:52.893516 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.893462    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77f11e0a-1467-45a1-8de7-64f98d14e9b6" (UID: "77f11e0a-1467-45a1-8de7-64f98d14e9b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:33:52.992207 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.992173    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-oauth-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:33:52.992207 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.992206    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:33:52.992207 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.992215    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77f11e0a-1467-45a1-8de7-64f98d14e9b6-console-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:33:52.992436 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.992225    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-oauth-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:33:52.992436 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.992234    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krmkt\" (UniqueName: \"kubernetes.io/projected/77f11e0a-1467-45a1-8de7-64f98d14e9b6-kube-api-access-krmkt\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:33:52.992436 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:52.992243    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77f11e0a-1467-45a1-8de7-64f98d14e9b6-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:33:53.655784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.654590    2580 generic.go:356] "Generic (PLEG): container finished" podID="77f11e0a-1467-45a1-8de7-64f98d14e9b6" containerID="43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95" exitCode=0
Jul 24 14:33:53.655784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.654700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfc858bcc-f5qwh" event={"ID":"77f11e0a-1467-45a1-8de7-64f98d14e9b6","Type":"ContainerDied","Data":"43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95"}
Jul 24 14:33:53.655784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.654780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfc858bcc-f5qwh" event={"ID":"77f11e0a-1467-45a1-8de7-64f98d14e9b6","Type":"ContainerDied","Data":"d9d6f87af6e5cf81ef519dede712b81e621bee15df412f79ef0e3e19541e32a4"}
Jul 24 14:33:53.655784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.654841    2580 scope.go:117] "RemoveContainer" containerID="43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95"
Jul 24 14:33:53.655784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.655028    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfc858bcc-f5qwh"
Jul 24 14:33:53.667032 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.667005    2580 scope.go:117] "RemoveContainer" containerID="43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95"
Jul 24 14:33:53.667415 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:33:53.667383    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95\": container with ID starting with 43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95 not found: ID does not exist" containerID="43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95"
Jul 24 14:33:53.667501 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.667428    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95"} err="failed to get container status \"43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95\": rpc error: code = NotFound desc = could not find container \"43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95\": container with ID starting with 43f7d164cc3ac2c0d5f7b4cfde00559b2801cffc821d10ff3e25a1a524afbd95 not found: ID does not exist"
Jul 24 14:33:53.671280 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.671255    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfc858bcc-f5qwh"]
Jul 24 14:33:53.675261 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:53.675239    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cfc858bcc-f5qwh"]
Jul 24 14:33:55.063573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:55.063541    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f11e0a-1467-45a1-8de7-64f98d14e9b6" path="/var/lib/kubelet/pods/77f11e0a-1467-45a1-8de7-64f98d14e9b6/volumes"
Jul 24 14:33:56.534198 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:56.534168    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jts5b"
Jul 24 14:33:59.012877 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:59.012847    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:33:59.016823 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:33:59.016801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7446c74b59-vxbp5"
Jul 24 14:34:01.659617 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:01.659579    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cdbbcd546-dhhnr" podUID="17462efa-3d26-4339-b002-cfc4b094b29b" containerName="console" containerID="cri-o://2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc" gracePeriod=15
Jul 24 14:34:01.945350 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:01.945319    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:34:02.068475 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-service-ca\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068475 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-serving-cert\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068758 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068516    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-trusted-ca-bundle\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068758 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-console-config\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068758 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2jcp\" (UniqueName: \"kubernetes.io/projected/17462efa-3d26-4339-b002-cfc4b094b29b-kube-api-access-f2jcp\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068946 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-oauth-config\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068946 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-oauth-serving-cert\") pod \"17462efa-3d26-4339-b002-cfc4b094b29b\" (UID: \"17462efa-3d26-4339-b002-cfc4b094b29b\") "
Jul 24 14:34:02.068946 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068926    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-service-ca" (OuterVolumeSpecName: "service-ca") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:34:02.069104 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.068971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-console-config" (OuterVolumeSpecName: "console-config") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:34:02.069104 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.069000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:34:02.069229 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.069209    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.069282 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.069255    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-trusted-ca-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.069282 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.069260    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:34:02.069282 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.069271    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-console-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.070821 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.070761    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:34:02.070930 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.070887    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17462efa-3d26-4339-b002-cfc4b094b29b-kube-api-access-f2jcp" (OuterVolumeSpecName: "kube-api-access-f2jcp") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "kube-api-access-f2jcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:34:02.070930 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.070894    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17462efa-3d26-4339-b002-cfc4b094b29b" (UID: "17462efa-3d26-4339-b002-cfc4b094b29b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:34:02.170355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.170267    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2jcp\" (UniqueName: \"kubernetes.io/projected/17462efa-3d26-4339-b002-cfc4b094b29b-kube-api-access-f2jcp\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.170355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.170298    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-oauth-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.170355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.170307    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17462efa-3d26-4339-b002-cfc4b094b29b-oauth-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.170355 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.170318    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17462efa-3d26-4339-b002-cfc4b094b29b-console-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:34:02.689804 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.689757    2580 generic.go:356] "Generic (PLEG): container finished" podID="17462efa-3d26-4339-b002-cfc4b094b29b" containerID="2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc" exitCode=0
Jul 24 14:34:02.690224 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.689815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdbbcd546-dhhnr" event={"ID":"17462efa-3d26-4339-b002-cfc4b094b29b","Type":"ContainerDied","Data":"2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc"}
Jul 24 14:34:02.690224 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.689833    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdbbcd546-dhhnr"
Jul 24 14:34:02.690224 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.689856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdbbcd546-dhhnr" event={"ID":"17462efa-3d26-4339-b002-cfc4b094b29b","Type":"ContainerDied","Data":"27e82f1d4768831d2752d93285249037d8e3104ef913e6c0dc571336827cf02e"}
Jul 24 14:34:02.690224 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.689875    2580 scope.go:117] "RemoveContainer" containerID="2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc"
Jul 24 14:34:02.698274 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.698255    2580 scope.go:117] "RemoveContainer" containerID="2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc"
Jul 24 14:34:02.698558 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:34:02.698539    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc\": container with ID starting with 2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc not found: ID does not exist" containerID="2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc"
Jul 24 14:34:02.698612 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.698568    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc"} err="failed to get container status \"2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc\": rpc error: code = NotFound desc = could not find container \"2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc\": container with ID starting with 2ed7e7ef83622b4c178180f644ed2355076bdebfd0ee27d71185630ecdff7ecc not found: ID does not exist"
Jul 24 14:34:02.713595 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.713565    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdbbcd546-dhhnr"]
Jul 24 14:34:02.718985 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:02.718963    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cdbbcd546-dhhnr"]
Jul 24 14:34:03.064008 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:34:03.063972    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17462efa-3d26-4339-b002-cfc4b094b29b" path="/var/lib/kubelet/pods/17462efa-3d26-4339-b002-cfc4b094b29b/volumes"
Jul 24 14:35:01.632513 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632435    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69875f8889-jx2bb"]
Jul 24 14:35:01.632980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632719    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f11e0a-1467-45a1-8de7-64f98d14e9b6" containerName="console"
Jul 24 14:35:01.632980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632732    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f11e0a-1467-45a1-8de7-64f98d14e9b6" containerName="console"
Jul 24 14:35:01.632980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632742    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17462efa-3d26-4339-b002-cfc4b094b29b" containerName="console"
Jul 24 14:35:01.632980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632749    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="17462efa-3d26-4339-b002-cfc4b094b29b" containerName="console"
Jul 24 14:35:01.632980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632823    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="17462efa-3d26-4339-b002-cfc4b094b29b" containerName="console"
Jul 24 14:35:01.632980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.632835    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f11e0a-1467-45a1-8de7-64f98d14e9b6" containerName="console"
Jul 24 14:35:01.634490 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.634474    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.647867 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.647834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69875f8889-jx2bb"]
Jul 24 14:35:01.702250 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-serving-cert\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.702250 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-trusted-ca-bundle\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.702458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-oauth-config\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.702458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8lnx\" (UniqueName: \"kubernetes.io/projected/e332f361-0427-440d-8660-0166da58e83f-kube-api-access-k8lnx\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.702458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-console-config\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.702458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-service-ca\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.702458 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.702435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-oauth-serving-cert\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803084 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-console-config\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803084 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-service-ca\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-oauth-serving-cert\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-serving-cert\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-trusted-ca-bundle\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-oauth-config\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8lnx\" (UniqueName: \"kubernetes.io/projected/e332f361-0427-440d-8660-0166da58e83f-kube-api-access-k8lnx\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.803921 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-console-config\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.804054 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-service-ca\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.804054 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.803995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-oauth-serving-cert\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.804214 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.804192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-trusted-ca-bundle\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.805671 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.805651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-serving-cert\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.805777 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.805745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-oauth-config\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.812366 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.812343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8lnx\" (UniqueName: \"kubernetes.io/projected/e332f361-0427-440d-8660-0166da58e83f-kube-api-access-k8lnx\") pod \"console-69875f8889-jx2bb\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") " pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:01.943595 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:01.943564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:02.072624 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:02.072538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69875f8889-jx2bb"]
Jul 24 14:35:02.075195 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:35:02.075170    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode332f361_0427_440d_8660_0166da58e83f.slice/crio-ba6871a9805faa71342087b206a82d845fa461cafb1adb2c3978c175cb1b2033 WatchSource:0}: Error finding container ba6871a9805faa71342087b206a82d845fa461cafb1adb2c3978c175cb1b2033: Status 404 returned error can't find the container with id ba6871a9805faa71342087b206a82d845fa461cafb1adb2c3978c175cb1b2033
Jul 24 14:35:02.898506 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:02.898474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69875f8889-jx2bb" event={"ID":"e332f361-0427-440d-8660-0166da58e83f","Type":"ContainerStarted","Data":"a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e"}
Jul 24 14:35:02.898506 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:02.898523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69875f8889-jx2bb" event={"ID":"e332f361-0427-440d-8660-0166da58e83f","Type":"ContainerStarted","Data":"ba6871a9805faa71342087b206a82d845fa461cafb1adb2c3978c175cb1b2033"}
Jul 24 14:35:02.918216 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:02.918164    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69875f8889-jx2bb" podStartSLOduration=1.918147098 podStartE2EDuration="1.918147098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:02.91793927 +0000 UTC m=+180.269784477" watchObservedRunningTime="2026-07-24 14:35:02.918147098 +0000 UTC m=+180.269992282"
Jul 24 14:35:11.944677 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:11.944645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:11.945115 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:11.944728    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:11.949485 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:11.949464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:12.937670 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:12.937636    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:35:13.023465 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:13.023435    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67484c6775-tk7ff"]
Jul 24 14:35:31.936781 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:31.936745    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"]
Jul 24 14:35:31.938931 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:31.938913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:31.943193 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:31.943171    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 14:35:31.943325 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:31.943212    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 14:35:31.943325 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:31.943217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x2p5s\""
Jul 24 14:35:31.950547 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:31.950522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"]
Jul 24 14:35:32.039499 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.039464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.039668 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.039537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg9r8\" (UniqueName: \"kubernetes.io/projected/6987314d-1e23-4313-84ef-a786fa0cc7f4-kube-api-access-fg9r8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.039668 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.039573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.140125 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.140082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.140278 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.140171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg9r8\" (UniqueName: \"kubernetes.io/projected/6987314d-1e23-4313-84ef-a786fa0cc7f4-kube-api-access-fg9r8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.140278 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.140200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.140569 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.140546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.140607 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.140553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.149715 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.149684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg9r8\" (UniqueName: \"kubernetes.io/projected/6987314d-1e23-4313-84ef-a786fa0cc7f4-kube-api-access-fg9r8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.248016 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.247934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:32.374850 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:32.374826    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"]
Jul 24 14:35:32.377291 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:35:32.377264    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6987314d_1e23_4313_84ef_a786fa0cc7f4.slice/crio-539d9a484dd7c89c77262199296b338943fd93261160fe641b5f88f300d0f3d6 WatchSource:0}: Error finding container 539d9a484dd7c89c77262199296b338943fd93261160fe641b5f88f300d0f3d6: Status 404 returned error can't find the container with id 539d9a484dd7c89c77262199296b338943fd93261160fe641b5f88f300d0f3d6
Jul 24 14:35:33.002854 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:33.002818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd" event={"ID":"6987314d-1e23-4313-84ef-a786fa0cc7f4","Type":"ContainerStarted","Data":"539d9a484dd7c89c77262199296b338943fd93261160fe641b5f88f300d0f3d6"}
Jul 24 14:35:38.042199 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.042163    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67484c6775-tk7ff" podUID="198637bf-3289-4ed0-adfa-73a22eef4db5" containerName="console" containerID="cri-o://4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f" gracePeriod=15
Jul 24 14:35:38.286605 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.286582    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:35:38.389841 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.389777    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-oauth-serving-cert\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.389841 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.389850    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-console-config\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.390096 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.389871    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-serving-cert\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.390096 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.389899    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nmxk\" (UniqueName: \"kubernetes.io/projected/198637bf-3289-4ed0-adfa-73a22eef4db5-kube-api-access-7nmxk\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.390096 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.389946    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-oauth-config\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.390250 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390088    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-trusted-ca-bundle\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.390250 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-service-ca\") pod \"198637bf-3289-4ed0-adfa-73a22eef4db5\" (UID: \"198637bf-3289-4ed0-adfa-73a22eef4db5\") "
Jul 24 14:35:38.390348 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390263    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:35:38.390422 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-console-config" (OuterVolumeSpecName: "console-config") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:35:38.390489 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390462    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-oauth-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:38.390538 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390495    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:35:38.390538 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.390533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-service-ca" (OuterVolumeSpecName: "service-ca") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:35:38.392086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.392063    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:35:38.392542 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.392518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:35:38.392637 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.392519    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198637bf-3289-4ed0-adfa-73a22eef4db5-kube-api-access-7nmxk" (OuterVolumeSpecName: "kube-api-access-7nmxk") pod "198637bf-3289-4ed0-adfa-73a22eef4db5" (UID: "198637bf-3289-4ed0-adfa-73a22eef4db5"). InnerVolumeSpecName "kube-api-access-7nmxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:38.491347 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.491311    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-oauth-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:38.491347 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.491340    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-trusted-ca-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:38.491347 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.491350    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:38.491580 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.491361    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198637bf-3289-4ed0-adfa-73a22eef4db5-console-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:38.491580 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.491369    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198637bf-3289-4ed0-adfa-73a22eef4db5-console-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:38.491580 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:38.491378    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nmxk\" (UniqueName: \"kubernetes.io/projected/198637bf-3289-4ed0-adfa-73a22eef4db5-kube-api-access-7nmxk\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:39.026976 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.026939    2580 generic.go:356] "Generic (PLEG): container finished" podID="198637bf-3289-4ed0-adfa-73a22eef4db5" containerID="4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f" exitCode=0
Jul 24 14:35:39.027160 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.027001    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67484c6775-tk7ff"
Jul 24 14:35:39.027160 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.027024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67484c6775-tk7ff" event={"ID":"198637bf-3289-4ed0-adfa-73a22eef4db5","Type":"ContainerDied","Data":"4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f"}
Jul 24 14:35:39.027160 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.027075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67484c6775-tk7ff" event={"ID":"198637bf-3289-4ed0-adfa-73a22eef4db5","Type":"ContainerDied","Data":"5efd4477c366f82ca3be5839e672992ec2e3353ca330ca9897f7c39740ca6b02"}
Jul 24 14:35:39.027160 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.027102    2580 scope.go:117] "RemoveContainer" containerID="4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f"
Jul 24 14:35:39.028657 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.028638    2580 generic.go:356] "Generic (PLEG): container finished" podID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerID="3fa908fd1e3472df8ccfeecefd5bb3aaa42d69891bc00bc5773a314daa960f9a" exitCode=0
Jul 24 14:35:39.028725 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.028679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd" event={"ID":"6987314d-1e23-4313-84ef-a786fa0cc7f4","Type":"ContainerDied","Data":"3fa908fd1e3472df8ccfeecefd5bb3aaa42d69891bc00bc5773a314daa960f9a"}
Jul 24 14:35:39.035769 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.035752    2580 scope.go:117] "RemoveContainer" containerID="4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f"
Jul 24 14:35:39.036121 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:35:39.036102    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f\": container with ID starting with 4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f not found: ID does not exist" containerID="4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f"
Jul 24 14:35:39.036187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.036168    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f"} err="failed to get container status \"4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f\": rpc error: code = NotFound desc = could not find container \"4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f\": container with ID starting with 4189dc86fd9158841a43df11b32fbedb885391ef61b815882c6989181ec6992f not found: ID does not exist"
Jul 24 14:35:39.073528 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.073499    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67484c6775-tk7ff"]
Jul 24 14:35:39.083098 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:39.083071    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67484c6775-tk7ff"]
Jul 24 14:35:41.064300 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:41.064276    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198637bf-3289-4ed0-adfa-73a22eef4db5" path="/var/lib/kubelet/pods/198637bf-3289-4ed0-adfa-73a22eef4db5/volumes"
Jul 24 14:35:42.043293 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:42.043257    2580 generic.go:356] "Generic (PLEG): container finished" podID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerID="5f068a948fc8f453bc1b024a9b217c2167fefe8bc278f4b1b5788bf02f8b82f0" exitCode=0
Jul 24 14:35:42.043521 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:42.043338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd" event={"ID":"6987314d-1e23-4313-84ef-a786fa0cc7f4","Type":"ContainerDied","Data":"5f068a948fc8f453bc1b024a9b217c2167fefe8bc278f4b1b5788bf02f8b82f0"}
Jul 24 14:35:49.071457 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:49.071420    2580 generic.go:356] "Generic (PLEG): container finished" podID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerID="6e90a692843eab9bd0648783f8fbad8dc19a4d2f65dbdf807f0c712b39e83fbc" exitCode=0
Jul 24 14:35:49.071857 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:49.071504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd" event={"ID":"6987314d-1e23-4313-84ef-a786fa0cc7f4","Type":"ContainerDied","Data":"6e90a692843eab9bd0648783f8fbad8dc19a4d2f65dbdf807f0c712b39e83fbc"}
Jul 24 14:35:50.193858 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.193834    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:50.288570 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.288533    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-util\") pod \"6987314d-1e23-4313-84ef-a786fa0cc7f4\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") "
Jul 24 14:35:50.288736 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.288589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg9r8\" (UniqueName: \"kubernetes.io/projected/6987314d-1e23-4313-84ef-a786fa0cc7f4-kube-api-access-fg9r8\") pod \"6987314d-1e23-4313-84ef-a786fa0cc7f4\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") "
Jul 24 14:35:50.288736 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.288634    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-bundle\") pod \"6987314d-1e23-4313-84ef-a786fa0cc7f4\" (UID: \"6987314d-1e23-4313-84ef-a786fa0cc7f4\") "
Jul 24 14:35:50.289333 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.289305    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-bundle" (OuterVolumeSpecName: "bundle") pod "6987314d-1e23-4313-84ef-a786fa0cc7f4" (UID: "6987314d-1e23-4313-84ef-a786fa0cc7f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:50.290757 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.290725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6987314d-1e23-4313-84ef-a786fa0cc7f4-kube-api-access-fg9r8" (OuterVolumeSpecName: "kube-api-access-fg9r8") pod "6987314d-1e23-4313-84ef-a786fa0cc7f4" (UID: "6987314d-1e23-4313-84ef-a786fa0cc7f4"). InnerVolumeSpecName "kube-api-access-fg9r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:50.293409 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.293390    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-util" (OuterVolumeSpecName: "util") pod "6987314d-1e23-4313-84ef-a786fa0cc7f4" (UID: "6987314d-1e23-4313-84ef-a786fa0cc7f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:50.389366 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.389279    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg9r8\" (UniqueName: \"kubernetes.io/projected/6987314d-1e23-4313-84ef-a786fa0cc7f4-kube-api-access-fg9r8\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:50.389366 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.389311    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:50.389366 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:50.389320    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6987314d-1e23-4313-84ef-a786fa0cc7f4-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:35:51.079988 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:51.079952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd" event={"ID":"6987314d-1e23-4313-84ef-a786fa0cc7f4","Type":"ContainerDied","Data":"539d9a484dd7c89c77262199296b338943fd93261160fe641b5f88f300d0f3d6"}
Jul 24 14:35:51.080164 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:51.080000    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="539d9a484dd7c89c77262199296b338943fd93261160fe641b5f88f300d0f3d6"
Jul 24 14:35:51.080164 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:51.079999    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kgbrd"
Jul 24 14:35:55.220036 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220006    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"]
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220254    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="extract"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220263    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="extract"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220276    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198637bf-3289-4ed0-adfa-73a22eef4db5" containerName="console"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220281    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="198637bf-3289-4ed0-adfa-73a22eef4db5" containerName="console"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220289    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="util"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220295    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="util"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220306    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="pull"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220311    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="pull"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220372    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6987314d-1e23-4313-84ef-a786fa0cc7f4" containerName="extract"
Jul 24 14:35:55.220417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.220380    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="198637bf-3289-4ed0-adfa-73a22eef4db5" containerName="console"
Jul 24 14:35:55.222224 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.222206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.226288 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.226268    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:35:55.226430 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.226294    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 14:35:55.226430 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.226371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kfhvw\""
Jul 24 14:35:55.241681 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.241660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"]
Jul 24 14:35:55.325986 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.325953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2sxg\" (UniqueName: \"kubernetes.io/projected/0964b8d2-199d-40b4-b358-f3f4d68f9587-kube-api-access-n2sxg\") pod \"cert-manager-operator-controller-manager-55c444bf86-jsvhb\" (UID: \"0964b8d2-199d-40b4-b358-f3f4d68f9587\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.325986 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.325991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0964b8d2-199d-40b4-b358-f3f4d68f9587-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jsvhb\" (UID: \"0964b8d2-199d-40b4-b358-f3f4d68f9587\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.426528 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.426485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2sxg\" (UniqueName: \"kubernetes.io/projected/0964b8d2-199d-40b4-b358-f3f4d68f9587-kube-api-access-n2sxg\") pod \"cert-manager-operator-controller-manager-55c444bf86-jsvhb\" (UID: \"0964b8d2-199d-40b4-b358-f3f4d68f9587\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.426700 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.426536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0964b8d2-199d-40b4-b358-f3f4d68f9587-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jsvhb\" (UID: \"0964b8d2-199d-40b4-b358-f3f4d68f9587\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.426949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.426929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0964b8d2-199d-40b4-b358-f3f4d68f9587-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jsvhb\" (UID: \"0964b8d2-199d-40b4-b358-f3f4d68f9587\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.441627 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.441596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2sxg\" (UniqueName: \"kubernetes.io/projected/0964b8d2-199d-40b4-b358-f3f4d68f9587-kube-api-access-n2sxg\") pod \"cert-manager-operator-controller-manager-55c444bf86-jsvhb\" (UID: \"0964b8d2-199d-40b4-b358-f3f4d68f9587\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.531861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.531785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"
Jul 24 14:35:55.675923 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:55.675235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb"]
Jul 24 14:35:55.681080 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:35:55.681051    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0964b8d2_199d_40b4_b358_f3f4d68f9587.slice/crio-2abc1b7bec7bcbce27deec53ce391c36c087b17a7a799bbece36fd0c95479861 WatchSource:0}: Error finding container 2abc1b7bec7bcbce27deec53ce391c36c087b17a7a799bbece36fd0c95479861: Status 404 returned error can't find the container with id 2abc1b7bec7bcbce27deec53ce391c36c087b17a7a799bbece36fd0c95479861
Jul 24 14:35:56.099094 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:56.099059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb" event={"ID":"0964b8d2-199d-40b4-b358-f3f4d68f9587","Type":"ContainerStarted","Data":"2abc1b7bec7bcbce27deec53ce391c36c087b17a7a799bbece36fd0c95479861"}
Jul 24 14:35:58.107845 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:58.107786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb" event={"ID":"0964b8d2-199d-40b4-b358-f3f4d68f9587","Type":"ContainerStarted","Data":"e091beba44c18d56b54426f63aea152fde762e2c4fc596be6522c4042c51dc5f"}
Jul 24 14:35:58.134851 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:58.134783    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jsvhb" podStartSLOduration=1.518436791 podStartE2EDuration="3.134766351s" totalImagesPullingTime="1.61632956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:58.132604215 +0000 UTC m=+235.484449401" watchObservedRunningTime="2026-07-24 14:35:58.134766351 +0000 UTC m=+235.486611536"
Jul 24 14:35:59.189607 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.186909    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcpg5"]
Jul 24 14:35:59.190987 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.190965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.193949 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.193930    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 14:35:59.194960 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.194944    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qdkqp\""
Jul 24 14:35:59.195005 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.194969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 14:35:59.200699 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.200673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcpg5"]
Jul 24 14:35:59.226048 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.226025    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"]
Jul 24 14:35:59.229137 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.229122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.231550 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.231527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x2p5s\""
Jul 24 14:35:59.231550 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.231561    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 14:35:59.231719 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.231581    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 14:35:59.243941 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.243917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"]
Jul 24 14:35:59.258931 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.258909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ffd47d1-f7f9-460b-aa73-bc4011f7ce63-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcpg5\" (UID: \"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.259038 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.258953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wrqt\" (UniqueName: \"kubernetes.io/projected/4ffd47d1-f7f9-460b-aa73-bc4011f7ce63-kube-api-access-9wrqt\") pod \"cert-manager-webhook-6486ffd997-lcpg5\" (UID: \"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.359572 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.359537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.359735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.359580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ffd47d1-f7f9-460b-aa73-bc4011f7ce63-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcpg5\" (UID: \"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.359735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.359617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrqt\" (UniqueName: \"kubernetes.io/projected/4ffd47d1-f7f9-460b-aa73-bc4011f7ce63-kube-api-access-9wrqt\") pod \"cert-manager-webhook-6486ffd997-lcpg5\" (UID: \"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.359735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.359640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.359735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.359663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbdg9\" (UniqueName: \"kubernetes.io/projected/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-kube-api-access-tbdg9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.368045 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.368018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ffd47d1-f7f9-460b-aa73-bc4011f7ce63-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lcpg5\" (UID: \"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.368236 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.368219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wrqt\" (UniqueName: \"kubernetes.io/projected/4ffd47d1-f7f9-460b-aa73-bc4011f7ce63-kube-api-access-9wrqt\") pod \"cert-manager-webhook-6486ffd997-lcpg5\" (UID: \"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.460423 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.460313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.460423 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.460403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.460665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.460434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbdg9\" (UniqueName: \"kubernetes.io/projected/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-kube-api-access-tbdg9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.460721 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.460683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.460721 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.460709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.472991 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.472963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbdg9\" (UniqueName: \"kubernetes.io/projected/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-kube-api-access-tbdg9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.508884 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.508844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:35:59.538085 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.538049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:35:59.657291 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.657264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lcpg5"]
Jul 24 14:35:59.659214 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:35:59.659188    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ffd47d1_f7f9_460b_aa73_bc4011f7ce63.slice/crio-0d1185e089d8aad1f14ca020bf6c7346caf7155516958a71f3f2cb8cc7e30c6d WatchSource:0}: Error finding container 0d1185e089d8aad1f14ca020bf6c7346caf7155516958a71f3f2cb8cc7e30c6d: Status 404 returned error can't find the container with id 0d1185e089d8aad1f14ca020bf6c7346caf7155516958a71f3f2cb8cc7e30c6d
Jul 24 14:35:59.686442 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:35:59.686324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"]
Jul 24 14:35:59.688961 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:35:59.688938    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c2a48a_2c4d_442e_8409_33bd2a4830b3.slice/crio-680b3708afc4ac1033593c0e38f92de12f8260f656353279abcd9e0e3c2bde9b WatchSource:0}: Error finding container 680b3708afc4ac1033593c0e38f92de12f8260f656353279abcd9e0e3c2bde9b: Status 404 returned error can't find the container with id 680b3708afc4ac1033593c0e38f92de12f8260f656353279abcd9e0e3c2bde9b
Jul 24 14:36:00.116952 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.116859    2580 generic.go:356] "Generic (PLEG): container finished" podID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerID="20a4dfc040ebdf5cd0a12bafc641908a1617aac46cdb8de66afd8554c336d494" exitCode=0
Jul 24 14:36:00.117132 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.116946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g" event={"ID":"a7c2a48a-2c4d-442e-8409-33bd2a4830b3","Type":"ContainerDied","Data":"20a4dfc040ebdf5cd0a12bafc641908a1617aac46cdb8de66afd8554c336d494"}
Jul 24 14:36:00.117132 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.117007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g" event={"ID":"a7c2a48a-2c4d-442e-8409-33bd2a4830b3","Type":"ContainerStarted","Data":"680b3708afc4ac1033593c0e38f92de12f8260f656353279abcd9e0e3c2bde9b"}
Jul 24 14:36:00.118151 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.118126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5" event={"ID":"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63","Type":"ContainerStarted","Data":"0d1185e089d8aad1f14ca020bf6c7346caf7155516958a71f3f2cb8cc7e30c6d"}
Jul 24 14:36:00.809048 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.808921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"]
Jul 24 14:36:00.812210 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.812187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:00.831220 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.831155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vnkmm\""
Jul 24 14:36:00.874701 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.874584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7722810a-bd8b-4c54-8590-3b91628a446b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pm8x2\" (UID: \"7722810a-bd8b-4c54-8590-3b91628a446b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:00.874701 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.874687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49z7w\" (UniqueName: \"kubernetes.io/projected/7722810a-bd8b-4c54-8590-3b91628a446b-kube-api-access-49z7w\") pod \"cert-manager-cainjector-559cdd8c87-pm8x2\" (UID: \"7722810a-bd8b-4c54-8590-3b91628a446b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:00.879091 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.879032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"]
Jul 24 14:36:00.975255 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.975224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7722810a-bd8b-4c54-8590-3b91628a446b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pm8x2\" (UID: \"7722810a-bd8b-4c54-8590-3b91628a446b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:00.975437 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.975313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49z7w\" (UniqueName: \"kubernetes.io/projected/7722810a-bd8b-4c54-8590-3b91628a446b-kube-api-access-49z7w\") pod \"cert-manager-cainjector-559cdd8c87-pm8x2\" (UID: \"7722810a-bd8b-4c54-8590-3b91628a446b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:00.991522 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.991493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49z7w\" (UniqueName: \"kubernetes.io/projected/7722810a-bd8b-4c54-8590-3b91628a446b-kube-api-access-49z7w\") pod \"cert-manager-cainjector-559cdd8c87-pm8x2\" (UID: \"7722810a-bd8b-4c54-8590-3b91628a446b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:00.992213 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:00.992171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7722810a-bd8b-4c54-8590-3b91628a446b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pm8x2\" (UID: \"7722810a-bd8b-4c54-8590-3b91628a446b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:01.125375 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:01.125171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"
Jul 24 14:36:01.290600 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:01.290542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2"]
Jul 24 14:36:01.293345 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:36:01.293309    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7722810a_bd8b_4c54_8590_3b91628a446b.slice/crio-316a50107d9da3c62f8e1e9e8e242e8a8ae5b31bf195bee083dcaa8f5a4788bf WatchSource:0}: Error finding container 316a50107d9da3c62f8e1e9e8e242e8a8ae5b31bf195bee083dcaa8f5a4788bf: Status 404 returned error can't find the container with id 316a50107d9da3c62f8e1e9e8e242e8a8ae5b31bf195bee083dcaa8f5a4788bf
Jul 24 14:36:02.130724 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:02.130684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2" event={"ID":"7722810a-bd8b-4c54-8590-3b91628a446b","Type":"ContainerStarted","Data":"316a50107d9da3c62f8e1e9e8e242e8a8ae5b31bf195bee083dcaa8f5a4788bf"}
Jul 24 14:36:04.139695 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.139659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2" event={"ID":"7722810a-bd8b-4c54-8590-3b91628a446b","Type":"ContainerStarted","Data":"2c4583010fc2726973de5c094a4758b34c14dea6bb45c8887c0fa7bb0973f926"}
Jul 24 14:36:04.141431 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.141406    2580 generic.go:356] "Generic (PLEG): container finished" podID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerID="262df5a06d1d0ceb252390e5e0663af958a10b2bfe29ba14a189fd859432d2cf" exitCode=0
Jul 24 14:36:04.141566 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.141497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g" event={"ID":"a7c2a48a-2c4d-442e-8409-33bd2a4830b3","Type":"ContainerDied","Data":"262df5a06d1d0ceb252390e5e0663af958a10b2bfe29ba14a189fd859432d2cf"}
Jul 24 14:36:04.142986 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.142966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5" event={"ID":"4ffd47d1-f7f9-460b-aa73-bc4011f7ce63","Type":"ContainerStarted","Data":"027e000487c7e59e0149e12e027b3edd9562370d1077bdf7401f7e65fd992489"}
Jul 24 14:36:04.143110 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.143095    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:36:04.167109 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.167064    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pm8x2" podStartSLOduration=2.292988329 podStartE2EDuration="4.167044594s" totalImagesPullingTime="1.874056265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:04.165405547 +0000 UTC m=+241.517250730" watchObservedRunningTime="2026-07-24 14:36:04.167044594 +0000 UTC m=+241.518889775"
Jul 24 14:36:04.209766 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:04.209708    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5" podStartSLOduration=1.71760686 podStartE2EDuration="5.209686274s" totalImagesPullingTime="3.492079414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:04.209243775 +0000 UTC m=+241.561088960" watchObservedRunningTime="2026-07-24 14:36:04.209686274 +0000 UTC m=+241.561531460"
Jul 24 14:36:05.148617 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:05.148586    2580 generic.go:356] "Generic (PLEG): container finished" podID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerID="f8252473b50d62c4f365245fabbdb4037d6fe930796fb74d7ac7344230dc203f" exitCode=0
Jul 24 14:36:05.149127 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:05.148659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g" event={"ID":"a7c2a48a-2c4d-442e-8409-33bd2a4830b3","Type":"ContainerDied","Data":"f8252473b50d62c4f365245fabbdb4037d6fe930796fb74d7ac7344230dc203f"}
Jul 24 14:36:06.274261 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.274233    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:36:06.420383 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.420345    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-bundle\") pod \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") "
Jul 24 14:36:06.420558 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.420413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbdg9\" (UniqueName: \"kubernetes.io/projected/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-kube-api-access-tbdg9\") pod \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") "
Jul 24 14:36:06.420558 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.420442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-util\") pod \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\" (UID: \"a7c2a48a-2c4d-442e-8409-33bd2a4830b3\") "
Jul 24 14:36:06.420874 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.420846    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-bundle" (OuterVolumeSpecName: "bundle") pod "a7c2a48a-2c4d-442e-8409-33bd2a4830b3" (UID: "a7c2a48a-2c4d-442e-8409-33bd2a4830b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:36:06.422536 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.422518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-kube-api-access-tbdg9" (OuterVolumeSpecName: "kube-api-access-tbdg9") pod "a7c2a48a-2c4d-442e-8409-33bd2a4830b3" (UID: "a7c2a48a-2c4d-442e-8409-33bd2a4830b3"). InnerVolumeSpecName "kube-api-access-tbdg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:36:06.424721 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.424691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-util" (OuterVolumeSpecName: "util") pod "a7c2a48a-2c4d-442e-8409-33bd2a4830b3" (UID: "a7c2a48a-2c4d-442e-8409-33bd2a4830b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:36:06.521233 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.521199    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:36:06.521233 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.521229    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbdg9\" (UniqueName: \"kubernetes.io/projected/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-kube-api-access-tbdg9\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:36:06.521233 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:06.521241    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c2a48a-2c4d-442e-8409-33bd2a4830b3-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:36:07.159033 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:07.158994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g" event={"ID":"a7c2a48a-2c4d-442e-8409-33bd2a4830b3","Type":"ContainerDied","Data":"680b3708afc4ac1033593c0e38f92de12f8260f656353279abcd9e0e3c2bde9b"}
Jul 24 14:36:07.159033 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:07.159035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9hg6g"
Jul 24 14:36:07.159215 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:07.159054    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="680b3708afc4ac1033593c0e38f92de12f8260f656353279abcd9e0e3c2bde9b"
Jul 24 14:36:10.151080 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:10.151045    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lcpg5"
Jul 24 14:36:17.214575 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214541    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"]
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214809    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="extract"
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214819    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="extract"
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214834    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="util"
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214839    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="util"
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214847    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="pull"
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214853    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="pull"
Jul 24 14:36:17.215070 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.214894    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c2a48a-2c4d-442e-8409-33bd2a4830b3" containerName="extract"
Jul 24 14:36:17.280342 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.280310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"]
Jul 24 14:36:17.280507 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.280402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.282999 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.282974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 14:36:17.282999 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.282984    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cn7j8\""
Jul 24 14:36:17.283626 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.283613    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:36:17.404178 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.404138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lbj\" (UniqueName: \"kubernetes.io/projected/7a61096f-46bd-4dba-ad73-5c9a986ab7a2-kube-api-access-t6lbj\") pod \"openshift-lws-operator-fd8ccff4c-7sq7p\" (UID: \"7a61096f-46bd-4dba-ad73-5c9a986ab7a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.404178 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.404179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a61096f-46bd-4dba-ad73-5c9a986ab7a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7sq7p\" (UID: \"7a61096f-46bd-4dba-ad73-5c9a986ab7a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.505618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.505530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lbj\" (UniqueName: \"kubernetes.io/projected/7a61096f-46bd-4dba-ad73-5c9a986ab7a2-kube-api-access-t6lbj\") pod \"openshift-lws-operator-fd8ccff4c-7sq7p\" (UID: \"7a61096f-46bd-4dba-ad73-5c9a986ab7a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.505618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.505576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a61096f-46bd-4dba-ad73-5c9a986ab7a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7sq7p\" (UID: \"7a61096f-46bd-4dba-ad73-5c9a986ab7a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.506018 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.505997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a61096f-46bd-4dba-ad73-5c9a986ab7a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7sq7p\" (UID: \"7a61096f-46bd-4dba-ad73-5c9a986ab7a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.513679 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.513653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lbj\" (UniqueName: \"kubernetes.io/projected/7a61096f-46bd-4dba-ad73-5c9a986ab7a2-kube-api-access-t6lbj\") pod \"openshift-lws-operator-fd8ccff4c-7sq7p\" (UID: \"7a61096f-46bd-4dba-ad73-5c9a986ab7a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.589636 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.589601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"
Jul 24 14:36:17.734771 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:17.734737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p"]
Jul 24 14:36:17.737961 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:36:17.737934    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a61096f_46bd_4dba_ad73_5c9a986ab7a2.slice/crio-f57982c9927afaceb55d3cab7e64243f3a9f50da8ea59b8902465bfccfbf3b29 WatchSource:0}: Error finding container f57982c9927afaceb55d3cab7e64243f3a9f50da8ea59b8902465bfccfbf3b29: Status 404 returned error can't find the container with id f57982c9927afaceb55d3cab7e64243f3a9f50da8ea59b8902465bfccfbf3b29
Jul 24 14:36:18.204403 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:18.204368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p" event={"ID":"7a61096f-46bd-4dba-ad73-5c9a986ab7a2","Type":"ContainerStarted","Data":"f57982c9927afaceb55d3cab7e64243f3a9f50da8ea59b8902465bfccfbf3b29"}
Jul 24 14:36:20.216363 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:20.216316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p" event={"ID":"7a61096f-46bd-4dba-ad73-5c9a986ab7a2","Type":"ContainerStarted","Data":"a36b8ae147ee934b96ccb5ad2fcd075771b3814238e835a2dd6396bba5148765"}
Jul 24 14:36:20.237269 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:20.237220    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7sq7p" podStartSLOduration=1.120919441 podStartE2EDuration="3.237203938s" totalImagesPullingTime="2.116284497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:20.234192713 +0000 UTC m=+257.586037896" watchObservedRunningTime="2026-07-24 14:36:20.237203938 +0000 UTC m=+257.589049127"
Jul 24 14:36:25.357318 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.357237    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"]
Jul 24 14:36:25.359460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.359442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.362051 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.362022    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 14:36:25.362203 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.362155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x2p5s\""
Jul 24 14:36:25.363029 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.363010    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 14:36:25.374225 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.374204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"]
Jul 24 14:36:25.472832 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.472779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.472997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.472913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.472997 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.472960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlcz2\" (UniqueName: \"kubernetes.io/projected/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-kube-api-access-tlcz2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.574331 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.574276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.574500 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.574344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlcz2\" (UniqueName: \"kubernetes.io/projected/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-kube-api-access-tlcz2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.574500 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.574406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.574708 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.574690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.574747 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.574730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.584269 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.584235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlcz2\" (UniqueName: \"kubernetes.io/projected/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-kube-api-access-tlcz2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.669081 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.669048    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:25.807245 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:25.807222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"]
Jul 24 14:36:25.809407 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:36:25.809377    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe88aa8b_be6a_46af_b75b_a19a6a1f74fc.slice/crio-a0b8f514be6ff5fddf271839e2e2b67600aac50c3b3bb7f3256025430c500914 WatchSource:0}: Error finding container a0b8f514be6ff5fddf271839e2e2b67600aac50c3b3bb7f3256025430c500914: Status 404 returned error can't find the container with id a0b8f514be6ff5fddf271839e2e2b67600aac50c3b3bb7f3256025430c500914
Jul 24 14:36:26.241618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:26.241580    2580 generic.go:356] "Generic (PLEG): container finished" podID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerID="aefcbdce839f663c4f68ae0ab632448077726d55934bd55a22963f18ef0e73b0" exitCode=0
Jul 24 14:36:26.241811 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:26.241666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv" event={"ID":"be88aa8b-be6a-46af-b75b-a19a6a1f74fc","Type":"ContainerDied","Data":"aefcbdce839f663c4f68ae0ab632448077726d55934bd55a22963f18ef0e73b0"}
Jul 24 14:36:26.241811 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:26.241717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv" event={"ID":"be88aa8b-be6a-46af-b75b-a19a6a1f74fc","Type":"ContainerStarted","Data":"a0b8f514be6ff5fddf271839e2e2b67600aac50c3b3bb7f3256025430c500914"}
Jul 24 14:36:27.247833 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:27.247774    2580 generic.go:356] "Generic (PLEG): container finished" podID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerID="78feedcd0b243492c23f815db07f4f93a42ea3785e1a2c4512de9fc35e9feb47" exitCode=0
Jul 24 14:36:27.248232 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:27.247843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv" event={"ID":"be88aa8b-be6a-46af-b75b-a19a6a1f74fc","Type":"ContainerDied","Data":"78feedcd0b243492c23f815db07f4f93a42ea3785e1a2c4512de9fc35e9feb47"}
Jul 24 14:36:28.254578 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:28.254539    2580 generic.go:356] "Generic (PLEG): container finished" podID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerID="221d2c778503d5a5485bb9cf0d9481b18bb12529f363afc97b82e793b604e36e" exitCode=0
Jul 24 14:36:28.254983 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:28.254618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv" event={"ID":"be88aa8b-be6a-46af-b75b-a19a6a1f74fc","Type":"ContainerDied","Data":"221d2c778503d5a5485bb9cf0d9481b18bb12529f363afc97b82e793b604e36e"}
Jul 24 14:36:29.381210 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.381185    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:29.506436 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.506398    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlcz2\" (UniqueName: \"kubernetes.io/projected/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-kube-api-access-tlcz2\") pod \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") "
Jul 24 14:36:29.506436 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.506437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-util\") pod \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") "
Jul 24 14:36:29.506631 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.506489    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-bundle\") pod \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\" (UID: \"be88aa8b-be6a-46af-b75b-a19a6a1f74fc\") "
Jul 24 14:36:29.507290 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.507267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-bundle" (OuterVolumeSpecName: "bundle") pod "be88aa8b-be6a-46af-b75b-a19a6a1f74fc" (UID: "be88aa8b-be6a-46af-b75b-a19a6a1f74fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:36:29.508582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.508564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-kube-api-access-tlcz2" (OuterVolumeSpecName: "kube-api-access-tlcz2") pod "be88aa8b-be6a-46af-b75b-a19a6a1f74fc" (UID: "be88aa8b-be6a-46af-b75b-a19a6a1f74fc"). InnerVolumeSpecName "kube-api-access-tlcz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:36:29.512008 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.511945    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-util" (OuterVolumeSpecName: "util") pod "be88aa8b-be6a-46af-b75b-a19a6a1f74fc" (UID: "be88aa8b-be6a-46af-b75b-a19a6a1f74fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:36:29.607589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.607558    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:36:29.607589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.607586    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlcz2\" (UniqueName: \"kubernetes.io/projected/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-kube-api-access-tlcz2\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:36:29.607589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:29.607597    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88aa8b-be6a-46af-b75b-a19a6a1f74fc-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:36:30.264644 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:30.264613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv" event={"ID":"be88aa8b-be6a-46af-b75b-a19a6a1f74fc","Type":"ContainerDied","Data":"a0b8f514be6ff5fddf271839e2e2b67600aac50c3b3bb7f3256025430c500914"}
Jul 24 14:36:30.264834 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:30.264663    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0b8f514be6ff5fddf271839e2e2b67600aac50c3b3bb7f3256025430c500914"
Jul 24 14:36:30.264834 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:30.264623    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6nbv"
Jul 24 14:36:33.253735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.253697    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"]
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254076    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="pull"
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254095    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="pull"
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254122    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="extract"
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254130    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="extract"
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254148    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="util"
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254157    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="util"
Jul 24 14:36:33.254231 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.254221    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="be88aa8b-be6a-46af-b75b-a19a6a1f74fc" containerName="extract"
Jul 24 14:36:33.256190 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.256168    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.259597 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.259569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 14:36:33.261716 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.261700    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bkrnw\""
Jul 24 14:36:33.261836 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.261820    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 14:36:33.263010 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.262969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 14:36:33.271321 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.271296    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"]
Jul 24 14:36:33.436200 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.436171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs26f\" (UniqueName: \"kubernetes.io/projected/17daa7da-e5d0-4758-aa33-c1e258422350-kube-api-access-hs26f\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.436401 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.436211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/17daa7da-e5d0-4758-aa33-c1e258422350-manager-config\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.436401 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.436232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17daa7da-e5d0-4758-aa33-c1e258422350-cert\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.436401 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.436358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/17daa7da-e5d0-4758-aa33-c1e258422350-metrics-cert\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.537599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.537510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17daa7da-e5d0-4758-aa33-c1e258422350-cert\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.537599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.537583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/17daa7da-e5d0-4758-aa33-c1e258422350-metrics-cert\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.537855 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.537618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs26f\" (UniqueName: \"kubernetes.io/projected/17daa7da-e5d0-4758-aa33-c1e258422350-kube-api-access-hs26f\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.537855 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.537646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/17daa7da-e5d0-4758-aa33-c1e258422350-manager-config\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.538346 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.538323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/17daa7da-e5d0-4758-aa33-c1e258422350-manager-config\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.540068 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.540041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/17daa7da-e5d0-4758-aa33-c1e258422350-metrics-cert\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.540168 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.540092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17daa7da-e5d0-4758-aa33-c1e258422350-cert\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.561589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.561561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs26f\" (UniqueName: \"kubernetes.io/projected/17daa7da-e5d0-4758-aa33-c1e258422350-kube-api-access-hs26f\") pod \"lws-controller-manager-55664b4b95-tpvtb\" (UID: \"17daa7da-e5d0-4758-aa33-c1e258422350\") " pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.565363 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.565347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:33.717030 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:33.716996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"]
Jul 24 14:36:33.720355 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:36:33.720327    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17daa7da_e5d0_4758_aa33_c1e258422350.slice/crio-0c03655ecfd7b83532f6a28b72831a5b73f045fe568fc107070dfb6ceebd70e5 WatchSource:0}: Error finding container 0c03655ecfd7b83532f6a28b72831a5b73f045fe568fc107070dfb6ceebd70e5: Status 404 returned error can't find the container with id 0c03655ecfd7b83532f6a28b72831a5b73f045fe568fc107070dfb6ceebd70e5
Jul 24 14:36:34.284247 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:34.284209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb" event={"ID":"17daa7da-e5d0-4758-aa33-c1e258422350","Type":"ContainerStarted","Data":"0c03655ecfd7b83532f6a28b72831a5b73f045fe568fc107070dfb6ceebd70e5"}
Jul 24 14:36:35.289861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:35.289776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb" event={"ID":"17daa7da-e5d0-4758-aa33-c1e258422350","Type":"ContainerStarted","Data":"acc100122eea534b811713c85019725132fb9559d6d4118ac61dc7d360b1a304"}
Jul 24 14:36:35.290308 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:35.289947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:35.333576 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:35.333525    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb" podStartSLOduration=0.876298244 podStartE2EDuration="2.333508375s" totalImagesPullingTime="1.457210131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:35.331618275 +0000 UTC m=+272.683463460" watchObservedRunningTime="2026-07-24 14:36:35.333508375 +0000 UTC m=+272.685353560"
Jul 24 14:36:38.508822 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.508776    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"]
Jul 24 14:36:38.511094 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.511077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.515346 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.515309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 14:36:38.515515 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.515437    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 14:36:38.515640 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.515606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 14:36:38.515775 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.515760    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p884f\""
Jul 24 14:36:38.515892 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.515833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 14:36:38.536893 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.536860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"]
Jul 24 14:36:38.570980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.570948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aad0b899-7def-4d5d-9b83-18451d52719b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.570980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.570986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad0b899-7def-4d5d-9b83-18451d52719b-tmp\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.571158 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.571010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aad0b899-7def-4d5d-9b83-18451d52719b-manifests\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.571158 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.571048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtf56\" (UniqueName: \"kubernetes.io/projected/aad0b899-7def-4d5d-9b83-18451d52719b-kube-api-access-xtf56\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.571158 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.571102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aad0b899-7def-4d5d-9b83-18451d52719b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.672145 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.672106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aad0b899-7def-4d5d-9b83-18451d52719b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.672333 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.672160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aad0b899-7def-4d5d-9b83-18451d52719b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.672333 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.672181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad0b899-7def-4d5d-9b83-18451d52719b-tmp\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.672333 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.672213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aad0b899-7def-4d5d-9b83-18451d52719b-manifests\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.672333 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.672240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtf56\" (UniqueName: \"kubernetes.io/projected/aad0b899-7def-4d5d-9b83-18451d52719b-kube-api-access-xtf56\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.672684 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.672658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aad0b899-7def-4d5d-9b83-18451d52719b-manifests\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.674488 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.674464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad0b899-7def-4d5d-9b83-18451d52719b-tmp\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.674595 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.674567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aad0b899-7def-4d5d-9b83-18451d52719b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.674702 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.674685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aad0b899-7def-4d5d-9b83-18451d52719b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.690316 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.690289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtf56\" (UniqueName: \"kubernetes.io/projected/aad0b899-7def-4d5d-9b83-18451d52719b-kube-api-access-xtf56\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-45rs4\" (UID: \"aad0b899-7def-4d5d-9b83-18451d52719b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.821887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.821777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:38.956811 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:38.956763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"]
Jul 24 14:36:38.959103 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:36:38.959078    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad0b899_7def_4d5d_9b83_18451d52719b.slice/crio-0e241b3a12b46c1f72c6ba9e3895acc16d958057de2e3dce5b90534c1346ef44 WatchSource:0}: Error finding container 0e241b3a12b46c1f72c6ba9e3895acc16d958057de2e3dce5b90534c1346ef44: Status 404 returned error can't find the container with id 0e241b3a12b46c1f72c6ba9e3895acc16d958057de2e3dce5b90534c1346ef44
Jul 24 14:36:39.307448 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:39.307411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4" event={"ID":"aad0b899-7def-4d5d-9b83-18451d52719b","Type":"ContainerStarted","Data":"0e241b3a12b46c1f72c6ba9e3895acc16d958057de2e3dce5b90534c1346ef44"}
Jul 24 14:36:42.323159 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:42.323066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4" event={"ID":"aad0b899-7def-4d5d-9b83-18451d52719b","Type":"ContainerStarted","Data":"b6e22a6fa5c55f8cbec383489e9320f4069b59d5c5fcf6df5d98ef6b45caa8e1"}
Jul 24 14:36:43.328779 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:43.328742    2580 generic.go:356] "Generic (PLEG): container finished" podID="aad0b899-7def-4d5d-9b83-18451d52719b" containerID="b6e22a6fa5c55f8cbec383489e9320f4069b59d5c5fcf6df5d98ef6b45caa8e1" exitCode=0
Jul 24 14:36:43.329218 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:43.328832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4" event={"ID":"aad0b899-7def-4d5d-9b83-18451d52719b","Type":"ContainerDied","Data":"b6e22a6fa5c55f8cbec383489e9320f4069b59d5c5fcf6df5d98ef6b45caa8e1"}
Jul 24 14:36:44.335177 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:44.335146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4" event={"ID":"aad0b899-7def-4d5d-9b83-18451d52719b","Type":"ContainerStarted","Data":"c3424bb36750ff2f75d819222dfd543fbc2ea2a71469e151947952a92a1df15f"}
Jul 24 14:36:44.335583 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:44.335267    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:36:44.365103 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:44.365040    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4" podStartSLOduration=1.928106538 podStartE2EDuration="6.365023194s" totalImagesPullingTime="3.387634208s" totalInitContainerRuntime="1.049282448s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:44.363392865 +0000 UTC m=+281.715238052" watchObservedRunningTime="2026-07-24 14:36:44.365023194 +0000 UTC m=+281.716868380"
Jul 24 14:36:46.296417 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:46.296385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55664b4b95-tpvtb"
Jul 24 14:36:55.342314 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:36:55.342281    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-45rs4"
Jul 24 14:37:02.984121 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:02.984093    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 14:37:08.280516 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.280478    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"]
Jul 24 14:37:08.285092 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.285070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.287645 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.287601    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 14:37:08.287783 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.287689    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 14:37:08.287783 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.287737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qr4vw\""
Jul 24 14:37:08.287976 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.287962    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 14:37:08.288089 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.288071    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 14:37:08.288345 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.288331    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 14:37:08.288424 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.288402    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 14:37:08.298718 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.298699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"]
Jul 24 14:37:08.410782 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.410738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.410942 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.410828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txwft\" (UniqueName: \"kubernetes.io/projected/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-kube-api-access-txwft\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.410942 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.410860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.410942 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.410888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.411063 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.410968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.411063 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.411008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.411063 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.411034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.511571 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.511571 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.511895 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.511895 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.511895 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txwft\" (UniqueName: \"kubernetes.io/projected/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-kube-api-access-txwft\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.511895 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.512098 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.511922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.512256 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.512234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.514089 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.514051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.514210 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.514129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.514210 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.514194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.514298 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.514196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.525829 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.525806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.530287 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.530262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txwft\" (UniqueName: \"kubernetes.io/projected/1fedbf58-2d97-49ad-aab5-8adad8b84e9c-kube-api-access-txwft\") pod \"istiod-openshift-gateway-5677ccb49b-mfkrm\" (UID: \"1fedbf58-2d97-49ad-aab5-8adad8b84e9c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.595362 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.595263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:08.738536 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.737683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"]
Jul 24 14:37:08.740666 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:37:08.740633    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fedbf58_2d97_49ad_aab5_8adad8b84e9c.slice/crio-385d67f2d6afe455c42acd92a059f38dc5c6fce76c1fdd8714e6e4826fd1879c WatchSource:0}: Error finding container 385d67f2d6afe455c42acd92a059f38dc5c6fce76c1fdd8714e6e4826fd1879c: Status 404 returned error can't find the container with id 385d67f2d6afe455c42acd92a059f38dc5c6fce76c1fdd8714e6e4826fd1879c
Jul 24 14:37:08.743162 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:08.743147    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:37:09.452245 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:09.452183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm" event={"ID":"1fedbf58-2d97-49ad-aab5-8adad8b84e9c","Type":"ContainerStarted","Data":"385d67f2d6afe455c42acd92a059f38dc5c6fce76c1fdd8714e6e4826fd1879c"}
Jul 24 14:37:10.967063 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:10.967021    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:37:10.967389 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:10.967093    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:37:11.464492 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:11.464459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm" event={"ID":"1fedbf58-2d97-49ad-aab5-8adad8b84e9c","Type":"ContainerStarted","Data":"4c330f5a419df902b8c96db8b18f1b4a72d425f183a8edd58b8af2ed0f81d354"}
Jul 24 14:37:11.464702 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:11.464630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:37:11.509332 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:11.509277    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm" podStartSLOduration=1.285783828 podStartE2EDuration="3.509260712s" totalImagesPullingTime="2.223476884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:11.505047629 +0000 UTC m=+308.856892815" watchObservedRunningTime="2026-07-24 14:37:11.509260712 +0000 UTC m=+308.861105898"
Jul 24 14:37:12.471047 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:37:12.471022    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mfkrm"
Jul 24 14:38:14.826148 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.826072    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"]
Jul 24 14:38:14.829525 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.829507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:14.832063 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.832040    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 14:38:14.832178 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.832166    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 14:38:14.833014 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.832994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dgd8w\""
Jul 24 14:38:14.838447 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.838425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"]
Jul 24 14:38:14.989569 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.989515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:14.989765 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.989601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:14.989765 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:14.989630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btfpn\" (UniqueName: \"kubernetes.io/projected/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-kube-api-access-btfpn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.090945 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.090775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.090945 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.090928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfpn\" (UniqueName: \"kubernetes.io/projected/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-kube-api-access-btfpn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.091165 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.090989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.091221 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.091190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.091304 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.091281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.099538 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.099517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btfpn\" (UniqueName: \"kubernetes.io/projected/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-kube-api-access-btfpn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.140488 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.140461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:15.271278 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.271246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"]
Jul 24 14:38:15.273389 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:38:15.273360    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d464ce_ff4b_4f2a_acd9_9c133a5efa08.slice/crio-6fe77b86b8be9ff9c453c2ff8d61e933dfc6724c1050f5174aa9a55e0bcb1325 WatchSource:0}: Error finding container 6fe77b86b8be9ff9c453c2ff8d61e933dfc6724c1050f5174aa9a55e0bcb1325: Status 404 returned error can't find the container with id 6fe77b86b8be9ff9c453c2ff8d61e933dfc6724c1050f5174aa9a55e0bcb1325
Jul 24 14:38:15.359140 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.359049    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"]
Jul 24 14:38:15.362641 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.362614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.372071 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.372042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"]
Jul 24 14:38:15.494466 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.494422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.494466 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.494486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg4ml\" (UniqueName: \"kubernetes.io/projected/c4f5d040-a3cd-4022-96aa-ce7465423dec-kube-api-access-lg4ml\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.494698 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.494556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.595284 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.595234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.595469 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.595299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4ml\" (UniqueName: \"kubernetes.io/projected/c4f5d040-a3cd-4022-96aa-ce7465423dec-kube-api-access-lg4ml\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.595469 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.595327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.595689 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.595674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.595735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.595680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.605857 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.605836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg4ml\" (UniqueName: \"kubernetes.io/projected/c4f5d040-a3cd-4022-96aa-ce7465423dec-kube-api-access-lg4ml\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.673554 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.673525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:15.747248 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.747216    2580 generic.go:356] "Generic (PLEG): container finished" podID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerID="d87ba23ea190a2dbabd469631fe207121f27b35f386977dac50c95919702f7e5" exitCode=0
Jul 24 14:38:15.747421 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.747278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg" event={"ID":"00d464ce-ff4b-4f2a-acd9-9c133a5efa08","Type":"ContainerDied","Data":"d87ba23ea190a2dbabd469631fe207121f27b35f386977dac50c95919702f7e5"}
Jul 24 14:38:15.747421 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.747340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg" event={"ID":"00d464ce-ff4b-4f2a-acd9-9c133a5efa08","Type":"ContainerStarted","Data":"6fe77b86b8be9ff9c453c2ff8d61e933dfc6724c1050f5174aa9a55e0bcb1325"}
Jul 24 14:38:15.761537 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.761506    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"]
Jul 24 14:38:15.765524 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.765500    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.774022 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.773993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"]
Jul 24 14:38:15.810718 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.810696    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"]
Jul 24 14:38:15.812721 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:38:15.812699    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f5d040_a3cd_4022_96aa_ce7465423dec.slice/crio-300f5079551c37928021e5439fcc3d79a01f50df5e8f7634b0e7b8aa0531f8bd WatchSource:0}: Error finding container 300f5079551c37928021e5439fcc3d79a01f50df5e8f7634b0e7b8aa0531f8bd: Status 404 returned error can't find the container with id 300f5079551c37928021e5439fcc3d79a01f50df5e8f7634b0e7b8aa0531f8bd
Jul 24 14:38:15.897482 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.897432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.897482 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.897482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.898116 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.897570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2d2\" (UniqueName: \"kubernetes.io/projected/9d9188c1-af15-4a55-9b09-1f7824f34497-kube-api-access-2b2d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.998034 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.997939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.998034 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.997999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.998460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.998040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2d2\" (UniqueName: \"kubernetes.io/projected/9d9188c1-af15-4a55-9b09-1f7824f34497-kube-api-access-2b2d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.998460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.998344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:15.998460 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:15.998361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:16.006375 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.006346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2d2\" (UniqueName: \"kubernetes.io/projected/9d9188c1-af15-4a55-9b09-1f7824f34497-kube-api-access-2b2d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:16.079485 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.079449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:16.187618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.187583    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"]
Jul 24 14:38:16.191309 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.191285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.201614 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.201586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"]
Jul 24 14:38:16.213856 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.213827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"]
Jul 24 14:38:16.217807 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:38:16.217770    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9188c1_af15_4a55_9b09_1f7824f34497.slice/crio-c681356f1c7ca7ca940467cc2daa416b86a52c0ecf41e5e921ead0c8ddea2bb0 WatchSource:0}: Error finding container c681356f1c7ca7ca940467cc2daa416b86a52c0ecf41e5e921ead0c8ddea2bb0: Status 404 returned error can't find the container with id c681356f1c7ca7ca940467cc2daa416b86a52c0ecf41e5e921ead0c8ddea2bb0
Jul 24 14:38:16.300943 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.300913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.301103 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.300991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.301103 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.301026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kdxf\" (UniqueName: \"kubernetes.io/projected/25f9fc7b-86d5-497f-b69f-64fabc1225b8-kube-api-access-6kdxf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.402424 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.402391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.402612 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.402442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kdxf\" (UniqueName: \"kubernetes.io/projected/25f9fc7b-86d5-497f-b69f-64fabc1225b8-kube-api-access-6kdxf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.402612 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.402476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.402787 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.402770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.402896 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.402871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.412494 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.412467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kdxf\" (UniqueName: \"kubernetes.io/projected/25f9fc7b-86d5-497f-b69f-64fabc1225b8-kube-api-access-6kdxf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.500965 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.500934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:16.665308 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.665286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"]
Jul 24 14:38:16.680824 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:38:16.680775    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f9fc7b_86d5_497f_b69f_64fabc1225b8.slice/crio-32341d6737556460225b56549b609d81a5c12ba3bb78b13a108e58b19ed69d63 WatchSource:0}: Error finding container 32341d6737556460225b56549b609d81a5c12ba3bb78b13a108e58b19ed69d63: Status 404 returned error can't find the container with id 32341d6737556460225b56549b609d81a5c12ba3bb78b13a108e58b19ed69d63
Jul 24 14:38:16.753190 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.753151    2580 generic.go:356] "Generic (PLEG): container finished" podID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerID="389e71793fa14052a5812edc52fb270a72849b356cffc1c32d68cf926c1a2a89" exitCode=0
Jul 24 14:38:16.753347 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.753240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw" event={"ID":"9d9188c1-af15-4a55-9b09-1f7824f34497","Type":"ContainerDied","Data":"389e71793fa14052a5812edc52fb270a72849b356cffc1c32d68cf926c1a2a89"}
Jul 24 14:38:16.753347 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.753305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw" event={"ID":"9d9188c1-af15-4a55-9b09-1f7824f34497","Type":"ContainerStarted","Data":"c681356f1c7ca7ca940467cc2daa416b86a52c0ecf41e5e921ead0c8ddea2bb0"}
Jul 24 14:38:16.755327 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.755300    2580 generic.go:356] "Generic (PLEG): container finished" podID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerID="0e8be51c5086eeb19d022ed995da9bf7b313aea4b704b841d9cb2adf32cfb408" exitCode=0
Jul 24 14:38:16.755430 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.755378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg" event={"ID":"00d464ce-ff4b-4f2a-acd9-9c133a5efa08","Type":"ContainerDied","Data":"0e8be51c5086eeb19d022ed995da9bf7b313aea4b704b841d9cb2adf32cfb408"}
Jul 24 14:38:16.757252 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.757227    2580 generic.go:356] "Generic (PLEG): container finished" podID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerID="b67e16fa6310089be5791d1c31d4afd7b8a1ec14038c8df80fbbc330e4a3531b" exitCode=0
Jul 24 14:38:16.757363 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.757324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd" event={"ID":"c4f5d040-a3cd-4022-96aa-ce7465423dec","Type":"ContainerDied","Data":"b67e16fa6310089be5791d1c31d4afd7b8a1ec14038c8df80fbbc330e4a3531b"}
Jul 24 14:38:16.757428 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.757369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd" event={"ID":"c4f5d040-a3cd-4022-96aa-ce7465423dec","Type":"ContainerStarted","Data":"300f5079551c37928021e5439fcc3d79a01f50df5e8f7634b0e7b8aa0531f8bd"}
Jul 24 14:38:16.759086 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.759046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb" event={"ID":"25f9fc7b-86d5-497f-b69f-64fabc1225b8","Type":"ContainerStarted","Data":"3f3ffb07b5a4622196f530b546d7257d6b299e4a539841acb2721995b4ddb80b"}
Jul 24 14:38:16.759190 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:16.759098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb" event={"ID":"25f9fc7b-86d5-497f-b69f-64fabc1225b8","Type":"ContainerStarted","Data":"32341d6737556460225b56549b609d81a5c12ba3bb78b13a108e58b19ed69d63"}
Jul 24 14:38:17.765565 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.765482    2580 generic.go:356] "Generic (PLEG): container finished" podID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerID="e6a12c72facb995f9a77dfdccb0c57d6eb4ab0c245f0f7de0b14504d0fa9baea" exitCode=0
Jul 24 14:38:17.766042 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.765570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg" event={"ID":"00d464ce-ff4b-4f2a-acd9-9c133a5efa08","Type":"ContainerDied","Data":"e6a12c72facb995f9a77dfdccb0c57d6eb4ab0c245f0f7de0b14504d0fa9baea"}
Jul 24 14:38:17.767371 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.767348    2580 generic.go:356] "Generic (PLEG): container finished" podID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerID="ed7b1b83d7b39c5ce4dc488845728e69b621ce78b5cc799d5fbf687c3fe1e3d6" exitCode=0
Jul 24 14:38:17.767455 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.767425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd" event={"ID":"c4f5d040-a3cd-4022-96aa-ce7465423dec","Type":"ContainerDied","Data":"ed7b1b83d7b39c5ce4dc488845728e69b621ce78b5cc799d5fbf687c3fe1e3d6"}
Jul 24 14:38:17.768972 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.768834    2580 generic.go:356] "Generic (PLEG): container finished" podID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerID="3f3ffb07b5a4622196f530b546d7257d6b299e4a539841acb2721995b4ddb80b" exitCode=0
Jul 24 14:38:17.768972 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.768930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb" event={"ID":"25f9fc7b-86d5-497f-b69f-64fabc1225b8","Type":"ContainerDied","Data":"3f3ffb07b5a4622196f530b546d7257d6b299e4a539841acb2721995b4ddb80b"}
Jul 24 14:38:17.770840 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.770818    2580 generic.go:356] "Generic (PLEG): container finished" podID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerID="28437b1fecf1390dd391392acc8ad3ada6443a614893fe51dbfaedde66e4749f" exitCode=0
Jul 24 14:38:17.770912 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:17.770850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw" event={"ID":"9d9188c1-af15-4a55-9b09-1f7824f34497","Type":"ContainerDied","Data":"28437b1fecf1390dd391392acc8ad3ada6443a614893fe51dbfaedde66e4749f"}
Jul 24 14:38:18.777394 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.777361    2580 generic.go:356] "Generic (PLEG): container finished" podID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerID="0a48fd4a26dc4edc82f26702ee7374abc4b2ce312c01f2aa049672060c247350" exitCode=0
Jul 24 14:38:18.777837 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.777451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw" event={"ID":"9d9188c1-af15-4a55-9b09-1f7824f34497","Type":"ContainerDied","Data":"0a48fd4a26dc4edc82f26702ee7374abc4b2ce312c01f2aa049672060c247350"}
Jul 24 14:38:18.779418 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.779394    2580 generic.go:356] "Generic (PLEG): container finished" podID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerID="512047ba47b22b4052f254c1a970b618f99f68dcca940db46cacbacf596cdcb4" exitCode=0
Jul 24 14:38:18.779558 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.779476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd" event={"ID":"c4f5d040-a3cd-4022-96aa-ce7465423dec","Type":"ContainerDied","Data":"512047ba47b22b4052f254c1a970b618f99f68dcca940db46cacbacf596cdcb4"}
Jul 24 14:38:18.781232 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.781215    2580 generic.go:356] "Generic (PLEG): container finished" podID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerID="009d16b10e80dcb3d2aab95184c37f0ba04b78bd3f178f17c2e40f87d7c48fee" exitCode=0
Jul 24 14:38:18.781318 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.781297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb" event={"ID":"25f9fc7b-86d5-497f-b69f-64fabc1225b8","Type":"ContainerDied","Data":"009d16b10e80dcb3d2aab95184c37f0ba04b78bd3f178f17c2e40f87d7c48fee"}
Jul 24 14:38:18.910743 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:18.910718    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:19.025298 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.025270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btfpn\" (UniqueName: \"kubernetes.io/projected/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-kube-api-access-btfpn\") pod \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") "
Jul 24 14:38:19.025492 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.025345    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-util\") pod \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") "
Jul 24 14:38:19.025492 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.025379    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-bundle\") pod \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\" (UID: \"00d464ce-ff4b-4f2a-acd9-9c133a5efa08\") "
Jul 24 14:38:19.026058 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.026029    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-bundle" (OuterVolumeSpecName: "bundle") pod "00d464ce-ff4b-4f2a-acd9-9c133a5efa08" (UID: "00d464ce-ff4b-4f2a-acd9-9c133a5efa08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:19.027422 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.027399    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-kube-api-access-btfpn" (OuterVolumeSpecName: "kube-api-access-btfpn") pod "00d464ce-ff4b-4f2a-acd9-9c133a5efa08" (UID: "00d464ce-ff4b-4f2a-acd9-9c133a5efa08"). InnerVolumeSpecName "kube-api-access-btfpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:19.030349 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.030330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-util" (OuterVolumeSpecName: "util") pod "00d464ce-ff4b-4f2a-acd9-9c133a5efa08" (UID: "00d464ce-ff4b-4f2a-acd9-9c133a5efa08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:19.126809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.126755    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btfpn\" (UniqueName: \"kubernetes.io/projected/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-kube-api-access-btfpn\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:19.126809 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.126785    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:19.126977 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.126819    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00d464ce-ff4b-4f2a-acd9-9c133a5efa08-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:19.788103 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.788072    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg"
Jul 24 14:38:19.788103 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.788094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg" event={"ID":"00d464ce-ff4b-4f2a-acd9-9c133a5efa08","Type":"ContainerDied","Data":"6fe77b86b8be9ff9c453c2ff8d61e933dfc6724c1050f5174aa9a55e0bcb1325"}
Jul 24 14:38:19.788599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.788137    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fe77b86b8be9ff9c453c2ff8d61e933dfc6724c1050f5174aa9a55e0bcb1325"
Jul 24 14:38:19.790507 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.790474    2580 generic.go:356] "Generic (PLEG): container finished" podID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerID="ceac5275eb3656c1f65af73d675747925c0a14c8d820477d8cd6a1d07c3981d8" exitCode=0
Jul 24 14:38:19.790654 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.790558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb" event={"ID":"25f9fc7b-86d5-497f-b69f-64fabc1225b8","Type":"ContainerDied","Data":"ceac5275eb3656c1f65af73d675747925c0a14c8d820477d8cd6a1d07c3981d8"}
Jul 24 14:38:19.926302 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.926274    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:19.959382 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:19.959359    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:20.031996 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.031960    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg4ml\" (UniqueName: \"kubernetes.io/projected/c4f5d040-a3cd-4022-96aa-ce7465423dec-kube-api-access-lg4ml\") pod \"c4f5d040-a3cd-4022-96aa-ce7465423dec\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") "
Jul 24 14:38:20.032156 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.032011    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-util\") pod \"c4f5d040-a3cd-4022-96aa-ce7465423dec\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") "
Jul 24 14:38:20.032156 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.032050    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-bundle\") pod \"c4f5d040-a3cd-4022-96aa-ce7465423dec\" (UID: \"c4f5d040-a3cd-4022-96aa-ce7465423dec\") "
Jul 24 14:38:20.032567 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.032532    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-bundle" (OuterVolumeSpecName: "bundle") pod "c4f5d040-a3cd-4022-96aa-ce7465423dec" (UID: "c4f5d040-a3cd-4022-96aa-ce7465423dec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:20.034032 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.034009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f5d040-a3cd-4022-96aa-ce7465423dec-kube-api-access-lg4ml" (OuterVolumeSpecName: "kube-api-access-lg4ml") pod "c4f5d040-a3cd-4022-96aa-ce7465423dec" (UID: "c4f5d040-a3cd-4022-96aa-ce7465423dec"). InnerVolumeSpecName "kube-api-access-lg4ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:20.037494 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.037454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-util" (OuterVolumeSpecName: "util") pod "c4f5d040-a3cd-4022-96aa-ce7465423dec" (UID: "c4f5d040-a3cd-4022-96aa-ce7465423dec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:20.133506 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-bundle\") pod \"9d9188c1-af15-4a55-9b09-1f7824f34497\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") "
Jul 24 14:38:20.133615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133533    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-util\") pod \"9d9188c1-af15-4a55-9b09-1f7824f34497\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") "
Jul 24 14:38:20.133615 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133552    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b2d2\" (UniqueName: \"kubernetes.io/projected/9d9188c1-af15-4a55-9b09-1f7824f34497-kube-api-access-2b2d2\") pod \"9d9188c1-af15-4a55-9b09-1f7824f34497\" (UID: \"9d9188c1-af15-4a55-9b09-1f7824f34497\") "
Jul 24 14:38:20.133719 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133707    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg4ml\" (UniqueName: \"kubernetes.io/projected/c4f5d040-a3cd-4022-96aa-ce7465423dec-kube-api-access-lg4ml\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:20.133751 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133724    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:20.133751 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133737    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f5d040-a3cd-4022-96aa-ce7465423dec-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:20.134022 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.133993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-bundle" (OuterVolumeSpecName: "bundle") pod "9d9188c1-af15-4a55-9b09-1f7824f34497" (UID: "9d9188c1-af15-4a55-9b09-1f7824f34497"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:20.135742 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.135709    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9188c1-af15-4a55-9b09-1f7824f34497-kube-api-access-2b2d2" (OuterVolumeSpecName: "kube-api-access-2b2d2") pod "9d9188c1-af15-4a55-9b09-1f7824f34497" (UID: "9d9188c1-af15-4a55-9b09-1f7824f34497"). InnerVolumeSpecName "kube-api-access-2b2d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:20.138700 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.138680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-util" (OuterVolumeSpecName: "util") pod "9d9188c1-af15-4a55-9b09-1f7824f34497" (UID: "9d9188c1-af15-4a55-9b09-1f7824f34497"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:20.234485 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.234451    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:20.234485 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.234479    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9188c1-af15-4a55-9b09-1f7824f34497-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:20.234485 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.234489    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b2d2\" (UniqueName: \"kubernetes.io/projected/9d9188c1-af15-4a55-9b09-1f7824f34497-kube-api-access-2b2d2\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:20.796874 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.796845    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd"
Jul 24 14:38:20.797278 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.796843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd" event={"ID":"c4f5d040-a3cd-4022-96aa-ce7465423dec","Type":"ContainerDied","Data":"300f5079551c37928021e5439fcc3d79a01f50df5e8f7634b0e7b8aa0531f8bd"}
Jul 24 14:38:20.797278 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.796985    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="300f5079551c37928021e5439fcc3d79a01f50df5e8f7634b0e7b8aa0531f8bd"
Jul 24 14:38:20.798576 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.798554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw" event={"ID":"9d9188c1-af15-4a55-9b09-1f7824f34497","Type":"ContainerDied","Data":"c681356f1c7ca7ca940467cc2daa416b86a52c0ecf41e5e921ead0c8ddea2bb0"}
Jul 24 14:38:20.798682 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.798587    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c681356f1c7ca7ca940467cc2daa416b86a52c0ecf41e5e921ead0c8ddea2bb0"
Jul 24 14:38:20.798682 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.798585    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw"
Jul 24 14:38:20.925407 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:20.925375    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:21.041303 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.041271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kdxf\" (UniqueName: \"kubernetes.io/projected/25f9fc7b-86d5-497f-b69f-64fabc1225b8-kube-api-access-6kdxf\") pod \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") "
Jul 24 14:38:21.041504 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.041334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-bundle\") pod \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") "
Jul 24 14:38:21.041504 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.041367    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-util\") pod \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\" (UID: \"25f9fc7b-86d5-497f-b69f-64fabc1225b8\") "
Jul 24 14:38:21.041921 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.041893    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-bundle" (OuterVolumeSpecName: "bundle") pod "25f9fc7b-86d5-497f-b69f-64fabc1225b8" (UID: "25f9fc7b-86d5-497f-b69f-64fabc1225b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:21.043315 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.043294    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f9fc7b-86d5-497f-b69f-64fabc1225b8-kube-api-access-6kdxf" (OuterVolumeSpecName: "kube-api-access-6kdxf") pod "25f9fc7b-86d5-497f-b69f-64fabc1225b8" (UID: "25f9fc7b-86d5-497f-b69f-64fabc1225b8"). InnerVolumeSpecName "kube-api-access-6kdxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:21.046768 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.046741    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-util" (OuterVolumeSpecName: "util") pod "25f9fc7b-86d5-497f-b69f-64fabc1225b8" (UID: "25f9fc7b-86d5-497f-b69f-64fabc1225b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:21.141974 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.141944    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kdxf\" (UniqueName: \"kubernetes.io/projected/25f9fc7b-86d5-497f-b69f-64fabc1225b8-kube-api-access-6kdxf\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:21.141974 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.141971    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:21.141974 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.141980    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f9fc7b-86d5-497f-b69f-64fabc1225b8-util\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:38:21.805283 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.805251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb"
Jul 24 14:38:21.805283 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.805273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb" event={"ID":"25f9fc7b-86d5-497f-b69f-64fabc1225b8","Type":"ContainerDied","Data":"32341d6737556460225b56549b609d81a5c12ba3bb78b13a108e58b19ed69d63"}
Jul 24 14:38:21.805704 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:38:21.805315    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32341d6737556460225b56549b609d81a5c12ba3bb78b13a108e58b19ed69d63"
Jul 24 14:39:38.397213 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397138    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397436    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397447    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397460    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397466    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397477    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397484    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397489    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397495    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397502    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397508    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397518    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397523    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397528    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397534    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397540    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397546    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397552    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397558    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397565    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397570    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397575    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397579    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="pull"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397585    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397590    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="util"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397642    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f5d040-a3cd-4022-96aa-ce7465423dec" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397650    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d464ce-ff4b-4f2a-acd9-9c133a5efa08" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397656    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="25f9fc7b-86d5-497f-b69f-64fabc1225b8" containerName="extract"
Jul 24 14:39:38.397673 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.397662    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9188c1-af15-4a55-9b09-1f7824f34497" containerName="extract"
Jul 24 14:39:38.400552 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.400537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.402781 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.402756    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 14:39:38.402913 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.402833    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dgd8w\""
Jul 24 14:39:38.403700 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.403677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 14:39:38.403700 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.403692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 14:39:38.408481 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.408460    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:38.491040 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.491009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:38.496185 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.496164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-config-file\") pod \"limitador-limitador-64c94fd64f-r7l66\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.496316 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.496197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xllt9\" (UniqueName: \"kubernetes.io/projected/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-kube-api-access-xllt9\") pod \"limitador-limitador-64c94fd64f-r7l66\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.597476 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.597443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-config-file\") pod \"limitador-limitador-64c94fd64f-r7l66\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.597669 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.597482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xllt9\" (UniqueName: \"kubernetes.io/projected/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-kube-api-access-xllt9\") pod \"limitador-limitador-64c94fd64f-r7l66\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.598206 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.598177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-config-file\") pod \"limitador-limitador-64c94fd64f-r7l66\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.607638 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.607612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xllt9\" (UniqueName: \"kubernetes.io/projected/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-kube-api-access-xllt9\") pod \"limitador-limitador-64c94fd64f-r7l66\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.711886 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.711838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:38.843410 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:38.843378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:38.844864 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:39:38.844838    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4388ab_e08e_4c1b_9cc3_b95d37d7e151.slice/crio-18e08e3f720c61429443eeff3fc8486b5a99b7e861ed1b4289a2531eb444d2d4 WatchSource:0}: Error finding container 18e08e3f720c61429443eeff3fc8486b5a99b7e861ed1b4289a2531eb444d2d4: Status 404 returned error can't find the container with id 18e08e3f720c61429443eeff3fc8486b5a99b7e861ed1b4289a2531eb444d2d4
Jul 24 14:39:39.176197 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:39.176167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66" event={"ID":"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151","Type":"ContainerStarted","Data":"18e08e3f720c61429443eeff3fc8486b5a99b7e861ed1b4289a2531eb444d2d4"}
Jul 24 14:39:42.193541 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:42.193506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66" event={"ID":"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151","Type":"ContainerStarted","Data":"d0222e7d03d40de7088a1caa0695cd6115aa5989749e60d6f3232a992a2b50a1"}
Jul 24 14:39:42.194087 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:42.193623    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:42.215301 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:42.215250    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66" podStartSLOduration=1.579878863 podStartE2EDuration="4.215231608s" totalImagesPullingTime="2.635352745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:42.214328692 +0000 UTC m=+459.566173877" watchObservedRunningTime="2026-07-24 14:39:42.215231608 +0000 UTC m=+459.567076792"
Jul 24 14:39:53.199195 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:53.199160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:55.476962 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:55.476918    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:55.477451 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:55.477182    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66" podUID="fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" containerName="limitador" containerID="cri-o://d0222e7d03d40de7088a1caa0695cd6115aa5989749e60d6f3232a992a2b50a1" gracePeriod=30
Jul 24 14:39:56.261896 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.261866    2580 generic.go:356] "Generic (PLEG): container finished" podID="fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" containerID="d0222e7d03d40de7088a1caa0695cd6115aa5989749e60d6f3232a992a2b50a1" exitCode=0
Jul 24 14:39:56.262081 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.261946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66" event={"ID":"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151","Type":"ContainerDied","Data":"d0222e7d03d40de7088a1caa0695cd6115aa5989749e60d6f3232a992a2b50a1"}
Jul 24 14:39:56.419110 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.419085    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:56.556052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.555954    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-config-file\") pod \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") "
Jul 24 14:39:56.556052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.556034    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xllt9\" (UniqueName: \"kubernetes.io/projected/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-kube-api-access-xllt9\") pod \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\" (UID: \"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151\") "
Jul 24 14:39:56.556573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.556377    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-config-file" (OuterVolumeSpecName: "config-file") pod "fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" (UID: "fa4388ab-e08e-4c1b-9cc3-b95d37d7e151"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:56.561943 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.561915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-kube-api-access-xllt9" (OuterVolumeSpecName: "kube-api-access-xllt9") pod "fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" (UID: "fa4388ab-e08e-4c1b-9cc3-b95d37d7e151"). InnerVolumeSpecName "kube-api-access-xllt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:56.656754 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.656719    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xllt9\" (UniqueName: \"kubernetes.io/projected/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-kube-api-access-xllt9\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:39:56.656754 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:56.656747    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151-config-file\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:39:57.267513 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:57.267479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66" event={"ID":"fa4388ab-e08e-4c1b-9cc3-b95d37d7e151","Type":"ContainerDied","Data":"18e08e3f720c61429443eeff3fc8486b5a99b7e861ed1b4289a2531eb444d2d4"}
Jul 24 14:39:57.267678 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:57.267536    2580 scope.go:117] "RemoveContainer" containerID="d0222e7d03d40de7088a1caa0695cd6115aa5989749e60d6f3232a992a2b50a1"
Jul 24 14:39:57.267678 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:57.267495    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7l66"
Jul 24 14:39:57.284389 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:57.284363    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:57.289957 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:57.289934    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7l66"]
Jul 24 14:39:59.064560 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:39:59.064526    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" path="/var/lib/kubelet/pods/fa4388ab-e08e-4c1b-9cc3-b95d37d7e151/volumes"
Jul 24 14:40:00.048391 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.048358    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"]
Jul 24 14:40:00.048676 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.048662    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" containerName="limitador"
Jul 24 14:40:00.048728 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.048678    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" containerName="limitador"
Jul 24 14:40:00.048772 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.048735    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa4388ab-e08e-4c1b-9cc3-b95d37d7e151" containerName="limitador"
Jul 24 14:40:00.052990 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.052974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.055526 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.055502    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 14:40:00.055657 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.055506    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:40:00.055657 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.055506    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 14:40:00.056357 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.056338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2cmkp\""
Jul 24 14:40:00.061064 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.061044    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"]
Jul 24 14:40:00.189586 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.189555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tg7z\" (UniqueName: \"kubernetes.io/projected/964f1f60-6dab-44df-af36-e3212ee0d0aa-kube-api-access-9tg7z\") pod \"postgres-69fb4594cf-6pq2z\" (UID: \"964f1f60-6dab-44df-af36-e3212ee0d0aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.190008 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.189622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/964f1f60-6dab-44df-af36-e3212ee0d0aa-data\") pod \"postgres-69fb4594cf-6pq2z\" (UID: \"964f1f60-6dab-44df-af36-e3212ee0d0aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.290887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.290854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/964f1f60-6dab-44df-af36-e3212ee0d0aa-data\") pod \"postgres-69fb4594cf-6pq2z\" (UID: \"964f1f60-6dab-44df-af36-e3212ee0d0aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.291055 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.290913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tg7z\" (UniqueName: \"kubernetes.io/projected/964f1f60-6dab-44df-af36-e3212ee0d0aa-kube-api-access-9tg7z\") pod \"postgres-69fb4594cf-6pq2z\" (UID: \"964f1f60-6dab-44df-af36-e3212ee0d0aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.291228 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.291209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/964f1f60-6dab-44df-af36-e3212ee0d0aa-data\") pod \"postgres-69fb4594cf-6pq2z\" (UID: \"964f1f60-6dab-44df-af36-e3212ee0d0aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.299342 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.299286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tg7z\" (UniqueName: \"kubernetes.io/projected/964f1f60-6dab-44df-af36-e3212ee0d0aa-kube-api-access-9tg7z\") pod \"postgres-69fb4594cf-6pq2z\" (UID: \"964f1f60-6dab-44df-af36-e3212ee0d0aa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.364898 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.364870    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:00.493956 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:00.493932    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"]
Jul 24 14:40:00.496045 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:40:00.496019    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964f1f60_6dab_44df_af36_e3212ee0d0aa.slice/crio-514e0f1b625f20c2b816501ae77a892d18088b5e580b6e54b1b76fd74bd9ebcd WatchSource:0}: Error finding container 514e0f1b625f20c2b816501ae77a892d18088b5e580b6e54b1b76fd74bd9ebcd: Status 404 returned error can't find the container with id 514e0f1b625f20c2b816501ae77a892d18088b5e580b6e54b1b76fd74bd9ebcd
Jul 24 14:40:01.287543 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:01.287511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z" event={"ID":"964f1f60-6dab-44df-af36-e3212ee0d0aa","Type":"ContainerStarted","Data":"514e0f1b625f20c2b816501ae77a892d18088b5e580b6e54b1b76fd74bd9ebcd"}
Jul 24 14:40:05.586618 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:05.586592    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 14:40:06.315656 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:06.315622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z" event={"ID":"964f1f60-6dab-44df-af36-e3212ee0d0aa","Type":"ContainerStarted","Data":"3e78170cdb8d3338149b578e05c6aa828eac8487186e3604d926dead06da578e"}
Jul 24 14:40:06.315861 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:06.315708    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:06.333980 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:06.333929    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z" podStartSLOduration=1.247569249 podStartE2EDuration="6.333911307s" totalImagesPullingTime="5.086342058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:06.331770732 +0000 UTC m=+483.683615918" watchObservedRunningTime="2026-07-24 14:40:06.333911307 +0000 UTC m=+483.685756540"
Jul 24 14:40:12.348654 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:12.348627    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6pq2z"
Jul 24 14:40:21.252483 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.252445    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77c497d9c-fk88l"]
Jul 24 14:40:21.283430 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.283399    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c497d9c-fk88l"]
Jul 24 14:40:21.283657 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.283493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.286324 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.286301    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jx5zn\""
Jul 24 14:40:21.286481 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.286324    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:40:21.286561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.286370    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:40:21.363573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.363541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rshw\" (UniqueName: \"kubernetes.io/projected/3e12ec9e-39d3-4655-9655-f7dc74460c40-kube-api-access-9rshw\") pod \"maas-controller-77c497d9c-fk88l\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") " pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.363740 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.363580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e12ec9e-39d3-4655-9655-f7dc74460c40-webhook-cert\") pod \"maas-controller-77c497d9c-fk88l\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") " pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.420668 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.420628    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cc6cf846f-xt4jq"]
Jul 24 14:40:21.424410 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.424388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.433934 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.433910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-xt4jq"]
Jul 24 14:40:21.464431 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.464400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b48da2b-c5d7-4237-954d-bbeb35311f4e-webhook-cert\") pod \"maas-controller-cc6cf846f-xt4jq\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") " pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.464599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.464434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9wwg\" (UniqueName: \"kubernetes.io/projected/0b48da2b-c5d7-4237-954d-bbeb35311f4e-kube-api-access-g9wwg\") pod \"maas-controller-cc6cf846f-xt4jq\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") " pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.464599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.464471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rshw\" (UniqueName: \"kubernetes.io/projected/3e12ec9e-39d3-4655-9655-f7dc74460c40-kube-api-access-9rshw\") pod \"maas-controller-77c497d9c-fk88l\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") " pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.464599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.464492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e12ec9e-39d3-4655-9655-f7dc74460c40-webhook-cert\") pod \"maas-controller-77c497d9c-fk88l\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") " pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.466977 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.466955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e12ec9e-39d3-4655-9655-f7dc74460c40-webhook-cert\") pod \"maas-controller-77c497d9c-fk88l\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") " pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.472448 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.472407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rshw\" (UniqueName: \"kubernetes.io/projected/3e12ec9e-39d3-4655-9655-f7dc74460c40-kube-api-access-9rshw\") pod \"maas-controller-77c497d9c-fk88l\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") " pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.565241 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.565157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b48da2b-c5d7-4237-954d-bbeb35311f4e-webhook-cert\") pod \"maas-controller-cc6cf846f-xt4jq\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") " pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.565241 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.565192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9wwg\" (UniqueName: \"kubernetes.io/projected/0b48da2b-c5d7-4237-954d-bbeb35311f4e-kube-api-access-g9wwg\") pod \"maas-controller-cc6cf846f-xt4jq\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") " pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.567570 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.567548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b48da2b-c5d7-4237-954d-bbeb35311f4e-webhook-cert\") pod \"maas-controller-cc6cf846f-xt4jq\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") " pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.573784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.573757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9wwg\" (UniqueName: \"kubernetes.io/projected/0b48da2b-c5d7-4237-954d-bbeb35311f4e-kube-api-access-g9wwg\") pod \"maas-controller-cc6cf846f-xt4jq\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") " pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.594413 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.594387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:21.724637 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.724610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c497d9c-fk88l"]
Jul 24 14:40:21.726772 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:40:21.726747    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e12ec9e_39d3_4655_9655_f7dc74460c40.slice/crio-cf582ca49eebbe2b252ad58abfeda673b7599f152b0b29e8a588f18716bcadac WatchSource:0}: Error finding container cf582ca49eebbe2b252ad58abfeda673b7599f152b0b29e8a588f18716bcadac: Status 404 returned error can't find the container with id cf582ca49eebbe2b252ad58abfeda673b7599f152b0b29e8a588f18716bcadac
Jul 24 14:40:21.735326 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.735303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:21.866776 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:21.866754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-xt4jq"]
Jul 24 14:40:21.868229 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:40:21.868203    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b48da2b_c5d7_4237_954d_bbeb35311f4e.slice/crio-e831fd8b47f72b66fdd0ad4c6cc4ff486f1d0b0d25e9a8fed6aeb57b24ad99ea WatchSource:0}: Error finding container e831fd8b47f72b66fdd0ad4c6cc4ff486f1d0b0d25e9a8fed6aeb57b24ad99ea: Status 404 returned error can't find the container with id e831fd8b47f72b66fdd0ad4c6cc4ff486f1d0b0d25e9a8fed6aeb57b24ad99ea
Jul 24 14:40:22.391665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:22.391618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c497d9c-fk88l" event={"ID":"3e12ec9e-39d3-4655-9655-f7dc74460c40","Type":"ContainerStarted","Data":"cf582ca49eebbe2b252ad58abfeda673b7599f152b0b29e8a588f18716bcadac"}
Jul 24 14:40:22.393291 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:22.393259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-xt4jq" event={"ID":"0b48da2b-c5d7-4237-954d-bbeb35311f4e","Type":"ContainerStarted","Data":"e831fd8b47f72b66fdd0ad4c6cc4ff486f1d0b0d25e9a8fed6aeb57b24ad99ea"}
Jul 24 14:40:24.408188 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:24.408153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-xt4jq" event={"ID":"0b48da2b-c5d7-4237-954d-bbeb35311f4e","Type":"ContainerStarted","Data":"31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4"}
Jul 24 14:40:24.408642 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:24.408486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:24.409784 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:24.409761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c497d9c-fk88l" event={"ID":"3e12ec9e-39d3-4655-9655-f7dc74460c40","Type":"ContainerStarted","Data":"5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417"}
Jul 24 14:40:24.409912 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:24.409895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:24.432285 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:24.432237    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cc6cf846f-xt4jq" podStartSLOduration=1.043373811 podStartE2EDuration="3.432218457s" totalImagesPullingTime="2.388844646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:24.43100934 +0000 UTC m=+501.782854527" watchObservedRunningTime="2026-07-24 14:40:24.432218457 +0000 UTC m=+501.784063642"
Jul 24 14:40:24.457593 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:24.457410    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77c497d9c-fk88l" podStartSLOduration=0.920031096 podStartE2EDuration="3.457386598s" totalImagesPullingTime="2.537355502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:24.451693173 +0000 UTC m=+501.803538358" watchObservedRunningTime="2026-07-24 14:40:24.457386598 +0000 UTC m=+501.809231785"
Jul 24 14:40:35.417346 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.417314    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:35.417823 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.417397    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:40:35.505686 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.505649    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c497d9c-fk88l"]
Jul 24 14:40:35.505906 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.505858    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77c497d9c-fk88l" podUID="3e12ec9e-39d3-4655-9655-f7dc74460c40" containerName="manager" containerID="cri-o://5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417" gracePeriod=30
Jul 24 14:40:35.748665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.748636    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:35.786714 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.786678    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rshw\" (UniqueName: \"kubernetes.io/projected/3e12ec9e-39d3-4655-9655-f7dc74460c40-kube-api-access-9rshw\") pod \"3e12ec9e-39d3-4655-9655-f7dc74460c40\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") "
Jul 24 14:40:35.786891 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.786756    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e12ec9e-39d3-4655-9655-f7dc74460c40-webhook-cert\") pod \"3e12ec9e-39d3-4655-9655-f7dc74460c40\" (UID: \"3e12ec9e-39d3-4655-9655-f7dc74460c40\") "
Jul 24 14:40:35.788933 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.788902    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e12ec9e-39d3-4655-9655-f7dc74460c40-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3e12ec9e-39d3-4655-9655-f7dc74460c40" (UID: "3e12ec9e-39d3-4655-9655-f7dc74460c40"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:40:35.788933 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.788922    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e12ec9e-39d3-4655-9655-f7dc74460c40-kube-api-access-9rshw" (OuterVolumeSpecName: "kube-api-access-9rshw") pod "3e12ec9e-39d3-4655-9655-f7dc74460c40" (UID: "3e12ec9e-39d3-4655-9655-f7dc74460c40"). InnerVolumeSpecName "kube-api-access-9rshw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:40:35.888252 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.888213    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rshw\" (UniqueName: \"kubernetes.io/projected/3e12ec9e-39d3-4655-9655-f7dc74460c40-kube-api-access-9rshw\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:40:35.888252 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:35.888246    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e12ec9e-39d3-4655-9655-f7dc74460c40-webhook-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:40:36.473129 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.473094    2580 generic.go:356] "Generic (PLEG): container finished" podID="3e12ec9e-39d3-4655-9655-f7dc74460c40" containerID="5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417" exitCode=0
Jul 24 14:40:36.473544 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.473138    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c497d9c-fk88l"
Jul 24 14:40:36.473544 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.473180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c497d9c-fk88l" event={"ID":"3e12ec9e-39d3-4655-9655-f7dc74460c40","Type":"ContainerDied","Data":"5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417"}
Jul 24 14:40:36.473544 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.473236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c497d9c-fk88l" event={"ID":"3e12ec9e-39d3-4655-9655-f7dc74460c40","Type":"ContainerDied","Data":"cf582ca49eebbe2b252ad58abfeda673b7599f152b0b29e8a588f18716bcadac"}
Jul 24 14:40:36.473544 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.473258    2580 scope.go:117] "RemoveContainer" containerID="5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417"
Jul 24 14:40:36.482130 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.482112    2580 scope.go:117] "RemoveContainer" containerID="5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417"
Jul 24 14:40:36.482386 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:40:36.482369    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417\": container with ID starting with 5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417 not found: ID does not exist" containerID="5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417"
Jul 24 14:40:36.482434 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.482396    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417"} err="failed to get container status \"5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417\": rpc error: code = NotFound desc = could not find container \"5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417\": container with ID starting with 5edc3b6b8bff1dfbc9ca0b22a70f5c58b826d72aa1207d5c9301d6b5015c9417 not found: ID does not exist"
Jul 24 14:40:36.495435 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.495409    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c497d9c-fk88l"]
Jul 24 14:40:36.499246 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:36.499215    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77c497d9c-fk88l"]
Jul 24 14:40:37.064739 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:37.064704    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e12ec9e-39d3-4655-9655-f7dc74460c40" path="/var/lib/kubelet/pods/3e12ec9e-39d3-4655-9655-f7dc74460c40/volumes"
Jul 24 14:40:57.851109 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.851013    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"]
Jul 24 14:40:57.851593 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.851402    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e12ec9e-39d3-4655-9655-f7dc74460c40" containerName="manager"
Jul 24 14:40:57.851593 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.851417    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e12ec9e-39d3-4655-9655-f7dc74460c40" containerName="manager"
Jul 24 14:40:57.851593 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.851467    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e12ec9e-39d3-4655-9655-f7dc74460c40" containerName="manager"
Jul 24 14:40:57.858723 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.858701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:57.862745 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.862714    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-52t98\""
Jul 24 14:40:57.863482 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.863469    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 14:40:57.884124 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.884097    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"]
Jul 24 14:40:57.978330 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.978295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2bbaca-4050-4cd2-af32-5f4238315ba8-maas-api-tls\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:57.978502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.978363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2bbaca-4050-4cd2-af32-5f4238315ba8-openshift-service-ca\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:57.978502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:57.978381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9g7\" (UniqueName: \"kubernetes.io/projected/4c2bbaca-4050-4cd2-af32-5f4238315ba8-kube-api-access-2h9g7\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.078982 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.078952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2bbaca-4050-4cd2-af32-5f4238315ba8-maas-api-tls\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.079161 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.079024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2bbaca-4050-4cd2-af32-5f4238315ba8-openshift-service-ca\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.079161 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.079043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9g7\" (UniqueName: \"kubernetes.io/projected/4c2bbaca-4050-4cd2-af32-5f4238315ba8-kube-api-access-2h9g7\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.079737 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.079716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2bbaca-4050-4cd2-af32-5f4238315ba8-openshift-service-ca\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.081348 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.081315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2bbaca-4050-4cd2-af32-5f4238315ba8-maas-api-tls\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.095905 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.095886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9g7\" (UniqueName: \"kubernetes.io/projected/4c2bbaca-4050-4cd2-af32-5f4238315ba8-kube-api-access-2h9g7\") pod \"maas-api-5858c6db48-5v5nk\" (UID: \"4c2bbaca-4050-4cd2-af32-5f4238315ba8\") " pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.168967 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.168937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:40:58.324238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.324206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"]
Jul 24 14:40:58.328107 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:40:58.328077    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2bbaca_4050_4cd2_af32_5f4238315ba8.slice/crio-34bcedbb1b3e3f7e1d6bac23de5c8585c0325529b8138741a12a6f4074af03ec WatchSource:0}: Error finding container 34bcedbb1b3e3f7e1d6bac23de5c8585c0325529b8138741a12a6f4074af03ec: Status 404 returned error can't find the container with id 34bcedbb1b3e3f7e1d6bac23de5c8585c0325529b8138741a12a6f4074af03ec
Jul 24 14:40:58.581908 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:58.581822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk" event={"ID":"4c2bbaca-4050-4cd2-af32-5f4238315ba8","Type":"ContainerStarted","Data":"34bcedbb1b3e3f7e1d6bac23de5c8585c0325529b8138741a12a6f4074af03ec"}
Jul 24 14:40:59.086344 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.086285    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"]
Jul 24 14:40:59.089724 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.089703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.092213 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.092189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zjjft\""
Jul 24 14:40:59.092352 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.092226    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 14:40:59.107502 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.107478    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"]
Jul 24 14:40:59.188143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.188063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfed338d-7103-4826-9ff3-95be30c465a4-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-8wjsn\" (UID: \"bfed338d-7103-4826-9ff3-95be30c465a4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.188143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.188126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdcrf\" (UniqueName: \"kubernetes.io/projected/bfed338d-7103-4826-9ff3-95be30c465a4-kube-api-access-bdcrf\") pod \"payload-pre-processing-687dbb6cf6-8wjsn\" (UID: \"bfed338d-7103-4826-9ff3-95be30c465a4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.289087 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.289054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfed338d-7103-4826-9ff3-95be30c465a4-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-8wjsn\" (UID: \"bfed338d-7103-4826-9ff3-95be30c465a4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.289281 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.289097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdcrf\" (UniqueName: \"kubernetes.io/projected/bfed338d-7103-4826-9ff3-95be30c465a4-kube-api-access-bdcrf\") pod \"payload-pre-processing-687dbb6cf6-8wjsn\" (UID: \"bfed338d-7103-4826-9ff3-95be30c465a4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.289948 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.289925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfed338d-7103-4826-9ff3-95be30c465a4-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-8wjsn\" (UID: \"bfed338d-7103-4826-9ff3-95be30c465a4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.297471 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.297449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdcrf\" (UniqueName: \"kubernetes.io/projected/bfed338d-7103-4826-9ff3-95be30c465a4-kube-api-access-bdcrf\") pod \"payload-pre-processing-687dbb6cf6-8wjsn\" (UID: \"bfed338d-7103-4826-9ff3-95be30c465a4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.403754 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.403656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:40:59.904369 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:40:59.904342    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"]
Jul 24 14:40:59.906781 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:40:59.906757    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfed338d_7103_4826_9ff3_95be30c465a4.slice/crio-5dc00ac4f3fea0a5fe1c30b4a21c17697780d9282f82ddc0fcab8c5aa7aea982 WatchSource:0}: Error finding container 5dc00ac4f3fea0a5fe1c30b4a21c17697780d9282f82ddc0fcab8c5aa7aea982: Status 404 returned error can't find the container with id 5dc00ac4f3fea0a5fe1c30b4a21c17697780d9282f82ddc0fcab8c5aa7aea982
Jul 24 14:41:00.596327 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:00.596040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk" event={"ID":"4c2bbaca-4050-4cd2-af32-5f4238315ba8","Type":"ContainerStarted","Data":"2cc7e1ac312c32e9e951316d5e736a3bfc08c65a3b3d2be2b1f9f1289cf70033"}
Jul 24 14:41:00.596327 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:00.596173    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:41:00.597687 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:00.597656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn" event={"ID":"bfed338d-7103-4826-9ff3-95be30c465a4","Type":"ContainerStarted","Data":"5dc00ac4f3fea0a5fe1c30b4a21c17697780d9282f82ddc0fcab8c5aa7aea982"}
Jul 24 14:41:00.618062 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:00.618012    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk" podStartSLOduration=2.144338848 podStartE2EDuration="3.617998008s" totalImagesPullingTime="1.47365916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:00.616542332 +0000 UTC m=+537.968387519" watchObservedRunningTime="2026-07-24 14:41:00.617998008 +0000 UTC m=+537.969843191"
Jul 24 14:41:04.620008 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:04.619970    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn" event={"ID":"bfed338d-7103-4826-9ff3-95be30c465a4","Type":"ContainerStarted","Data":"9b6a3e6c65469bcd736fb40b4f4589f0e4e2c9a52c7e5561cb2fd2260d41deff"}
Jul 24 14:41:04.620435 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:04.620099    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:41:04.647413 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:04.647359    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn" podStartSLOduration=1.578937917 podStartE2EDuration="5.647344261s" totalImagesPullingTime="4.068406344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:04.645082103 +0000 UTC m=+541.996927290" watchObservedRunningTime="2026-07-24 14:41:04.647344261 +0000 UTC m=+541.999189504"
Jul 24 14:41:06.608669 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:06.608639    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5858c6db48-5v5nk"
Jul 24 14:41:15.626988 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:41:15.626955    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8wjsn"
Jul 24 14:42:12.814371 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.814335    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"]
Jul 24 14:42:12.817645 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.817627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:12.820364 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.820344    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 14:42:12.821068 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.821049    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gkqfh\""
Jul 24 14:42:12.821187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.821089    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 14:42:12.821187 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.821163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 14:42:12.829472 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.829453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"]
Jul 24 14:42:12.927994 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.927945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbnpl\" (UniqueName: \"kubernetes.io/projected/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-kube-api-access-jbnpl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:12.928325 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.928301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:12.928437 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.928424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:12.928548 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.928534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:12.928666 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.928654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:12.928819 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:12.928781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.029763 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.029724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.029932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.029771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.029932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.029832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.029932 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.029870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbnpl\" (UniqueName: \"kubernetes.io/projected/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-kube-api-access-jbnpl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.030050 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.029931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.030050 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.029954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.030271 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.030240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.030385 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.030287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.030385 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.030328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.031963 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.031945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.032212 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.032194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.040620 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.040599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbnpl\" (UniqueName: \"kubernetes.io/projected/350deba7-2ac6-47e8-bbbf-c0a4da32c7da-kube-api-access-jbnpl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8hfxl\" (UID: \"350deba7-2ac6-47e8-bbbf-c0a4da32c7da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.127541 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.127465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:13.262530 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.262500    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"]
Jul 24 14:42:13.264154 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:42:13.264130    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350deba7_2ac6_47e8_bbbf_c0a4da32c7da.slice/crio-bc63a753bc451699b233410aa4237117a038a794f41dd8130479a4ce1c48345d WatchSource:0}: Error finding container bc63a753bc451699b233410aa4237117a038a794f41dd8130479a4ce1c48345d: Status 404 returned error can't find the container with id bc63a753bc451699b233410aa4237117a038a794f41dd8130479a4ce1c48345d
Jul 24 14:42:13.265359 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.265342    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:42:13.956359 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:13.956326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl" event={"ID":"350deba7-2ac6-47e8-bbbf-c0a4da32c7da","Type":"ContainerStarted","Data":"bc63a753bc451699b233410aa4237117a038a794f41dd8130479a4ce1c48345d"}
Jul 24 14:42:14.962765 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:14.962729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl" event={"ID":"350deba7-2ac6-47e8-bbbf-c0a4da32c7da","Type":"ContainerStarted","Data":"034c101a0af576338a75b047ce04ea7fe1eb59b273ed4847424aea691522cc1f"}
Jul 24 14:42:14.981023 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:14.980963    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl" podStartSLOduration=1.999894364 podStartE2EDuration="2.98094189s" totalImagesPullingTime="981.047526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:42:14.980068201 +0000 UTC m=+612.331913385" watchObservedRunningTime="2026-07-24 14:42:14.98094189 +0000 UTC m=+612.332787075"
Jul 24 14:42:23.128013 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:23.127970    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:23.128402 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:23.128043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:23.140545 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:23.140521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:24.018202 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:24.018173    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8hfxl"
Jul 24 14:42:35.811143 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.811064    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"]
Jul 24 14:42:35.814735 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.814713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:35.817561 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.817542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 14:42:35.823996 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.823971    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"]
Jul 24 14:42:35.933837 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.933785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:35.934025 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.933847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:35.934025 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.933878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73d47cd-7ed9-4c7c-915f-21ea896d8866-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:35.934127 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.934053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:35.934127 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.934116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2sdl\" (UniqueName: \"kubernetes.io/projected/e73d47cd-7ed9-4c7c-915f-21ea896d8866-kube-api-access-b2sdl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:35.934203 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:35.934161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035243 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2sdl\" (UniqueName: \"kubernetes.io/projected/e73d47cd-7ed9-4c7c-915f-21ea896d8866-kube-api-access-b2sdl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73d47cd-7ed9-4c7c-915f-21ea896d8866-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035419 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035694 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035838 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.035838 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.035775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.037484 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.037458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e73d47cd-7ed9-4c7c-915f-21ea896d8866-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.037624 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.037608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e73d47cd-7ed9-4c7c-915f-21ea896d8866-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.043728 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.043704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2sdl\" (UniqueName: \"kubernetes.io/projected/e73d47cd-7ed9-4c7c-915f-21ea896d8866-kube-api-access-b2sdl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2\" (UID: \"e73d47cd-7ed9-4c7c-915f-21ea896d8866\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.126358 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.126272    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:36.261611 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:36.261576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"]
Jul 24 14:42:36.263020 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:42:36.262996    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73d47cd_7ed9_4c7c_915f_21ea896d8866.slice/crio-f9fdd3aae8154e0fa8fdde821234bf504a0c9a547142e883d4515683ee8eddd0 WatchSource:0}: Error finding container f9fdd3aae8154e0fa8fdde821234bf504a0c9a547142e883d4515683ee8eddd0: Status 404 returned error can't find the container with id f9fdd3aae8154e0fa8fdde821234bf504a0c9a547142e883d4515683ee8eddd0
Jul 24 14:42:37.072280 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:37.072240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2" event={"ID":"e73d47cd-7ed9-4c7c-915f-21ea896d8866","Type":"ContainerStarted","Data":"b2264b0c5df987954bd88a84a03ec3f0b62586adb4eb46d1b8bb139234c9e59b"}
Jul 24 14:42:37.072773 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:37.072301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2" event={"ID":"e73d47cd-7ed9-4c7c-915f-21ea896d8866","Type":"ContainerStarted","Data":"f9fdd3aae8154e0fa8fdde821234bf504a0c9a547142e883d4515683ee8eddd0"}
Jul 24 14:42:37.108331 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:37.108273    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2" podStartSLOduration=1.92034958 podStartE2EDuration="2.108256255s" totalImagesPullingTime="187.906675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:42:37.107223403 +0000 UTC m=+634.459068588" watchObservedRunningTime="2026-07-24 14:42:37.108256255 +0000 UTC m=+634.460101439"
Jul 24 14:42:41.397433 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.397397    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"]
Jul 24 14:42:41.401953 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.401927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.404549 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.404524    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 14:42:41.411628 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.411606    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"]
Jul 24 14:42:41.486852 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.486816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f17d856-a902-4049-9bba-d4dc07b197f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.487007 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.486875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.487007 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.486924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.487007 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.486962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.487007 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.486988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.487197 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.487006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmc6b\" (UniqueName: \"kubernetes.io/projected/9f17d856-a902-4049-9bba-d4dc07b197f6-kube-api-access-rmc6b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.587602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.587518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f17d856-a902-4049-9bba-d4dc07b197f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.587602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.587584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.587848 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.587615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.587848 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.587650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.587848 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.587684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.587848 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.587707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmc6b\" (UniqueName: \"kubernetes.io/projected/9f17d856-a902-4049-9bba-d4dc07b197f6-kube-api-access-rmc6b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.588170 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.588143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.588372 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.588343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.588440 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.588424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.590077 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.590057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f17d856-a902-4049-9bba-d4dc07b197f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.590195 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.590177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f17d856-a902-4049-9bba-d4dc07b197f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.596681 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.596657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmc6b\" (UniqueName: \"kubernetes.io/projected/9f17d856-a902-4049-9bba-d4dc07b197f6-kube-api-access-rmc6b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m77hv\" (UID: \"9f17d856-a902-4049-9bba-d4dc07b197f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.715512 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.715472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:41.848484 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:41.848452    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"]
Jul 24 14:42:41.849993 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:42:41.849968    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f17d856_a902_4049_9bba_d4dc07b197f6.slice/crio-8c0fdad910d4996c00127ac0531c43efd6486971abe6eac8f9d509937a9a2703 WatchSource:0}: Error finding container 8c0fdad910d4996c00127ac0531c43efd6486971abe6eac8f9d509937a9a2703: Status 404 returned error can't find the container with id 8c0fdad910d4996c00127ac0531c43efd6486971abe6eac8f9d509937a9a2703
Jul 24 14:42:42.097598 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:42.097548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv" event={"ID":"9f17d856-a902-4049-9bba-d4dc07b197f6","Type":"ContainerStarted","Data":"8c0fdad910d4996c00127ac0531c43efd6486971abe6eac8f9d509937a9a2703"}
Jul 24 14:42:43.103545 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:43.103510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv" event={"ID":"9f17d856-a902-4049-9bba-d4dc07b197f6","Type":"ContainerStarted","Data":"d59e58ab82c0b680e294cc844be5d3661df8f8b3b9084365c91b85061c14d6f5"}
Jul 24 14:42:43.126583 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:43.126526    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv" podStartSLOduration=1.902052618 podStartE2EDuration="2.126508636s" totalImagesPullingTime="224.456018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:42:43.124245259 +0000 UTC m=+640.476090445" watchObservedRunningTime="2026-07-24 14:42:43.126508636 +0000 UTC m=+640.478353820"
Jul 24 14:42:46.126497 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:46.126466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:46.127001 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:46.126520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:46.138958 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:46.138934    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:47.133058 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:47.133028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2"
Jul 24 14:42:51.716663 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:51.716622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:51.717097 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:51.716695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:51.729038 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:51.729017    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:42:52.158505 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:42:52.158477    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m77hv"
Jul 24 14:44:29.962293 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:29.962256    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-xt4jq"]
Jul 24 14:44:29.962963 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:29.962504    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cc6cf846f-xt4jq" podUID="0b48da2b-c5d7-4237-954d-bbeb35311f4e" containerName="manager" containerID="cri-o://31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4" gracePeriod=30
Jul 24 14:44:30.210698 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.210674    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:44:30.237054 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.236976    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9wwg\" (UniqueName: \"kubernetes.io/projected/0b48da2b-c5d7-4237-954d-bbeb35311f4e-kube-api-access-g9wwg\") pod \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") "
Jul 24 14:44:30.237054 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.237037    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b48da2b-c5d7-4237-954d-bbeb35311f4e-webhook-cert\") pod \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\" (UID: \"0b48da2b-c5d7-4237-954d-bbeb35311f4e\") "
Jul 24 14:44:30.239196 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.239169    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b48da2b-c5d7-4237-954d-bbeb35311f4e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0b48da2b-c5d7-4237-954d-bbeb35311f4e" (UID: "0b48da2b-c5d7-4237-954d-bbeb35311f4e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:44:30.239313 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.239194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b48da2b-c5d7-4237-954d-bbeb35311f4e-kube-api-access-g9wwg" (OuterVolumeSpecName: "kube-api-access-g9wwg") pod "0b48da2b-c5d7-4237-954d-bbeb35311f4e" (UID: "0b48da2b-c5d7-4237-954d-bbeb35311f4e"). InnerVolumeSpecName "kube-api-access-g9wwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:44:30.337664 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.337626    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b48da2b-c5d7-4237-954d-bbeb35311f4e-webhook-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:44:30.337664 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.337656    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9wwg\" (UniqueName: \"kubernetes.io/projected/0b48da2b-c5d7-4237-954d-bbeb35311f4e-kube-api-access-g9wwg\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:44:30.646083 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.645989    2580 generic.go:356] "Generic (PLEG): container finished" podID="0b48da2b-c5d7-4237-954d-bbeb35311f4e" containerID="31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4" exitCode=0
Jul 24 14:44:30.646083 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.646034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-xt4jq" event={"ID":"0b48da2b-c5d7-4237-954d-bbeb35311f4e","Type":"ContainerDied","Data":"31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4"}
Jul 24 14:44:30.646083 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.646040    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-xt4jq"
Jul 24 14:44:30.646083 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.646075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-xt4jq" event={"ID":"0b48da2b-c5d7-4237-954d-bbeb35311f4e","Type":"ContainerDied","Data":"e831fd8b47f72b66fdd0ad4c6cc4ff486f1d0b0d25e9a8fed6aeb57b24ad99ea"}
Jul 24 14:44:30.646403 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.646099    2580 scope.go:117] "RemoveContainer" containerID="31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4"
Jul 24 14:44:30.655124 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.655105    2580 scope.go:117] "RemoveContainer" containerID="31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4"
Jul 24 14:44:30.655381 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:44:30.655358    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4\": container with ID starting with 31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4 not found: ID does not exist" containerID="31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4"
Jul 24 14:44:30.655447 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.655390    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4"} err="failed to get container status \"31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4\": rpc error: code = NotFound desc = could not find container \"31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4\": container with ID starting with 31c5f8cc7ed53593b4c3e19d120f69fcbfee0a3edcc4dbaebe3558c2a226b2d4 not found: ID does not exist"
Jul 24 14:44:30.667852 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.667819    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-xt4jq"]
Jul 24 14:44:30.674132 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:30.674112    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-xt4jq"]
Jul 24 14:44:31.064329 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:44:31.064297    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b48da2b-c5d7-4237-954d-bbeb35311f4e" path="/var/lib/kubelet/pods/0b48da2b-c5d7-4237-954d-bbeb35311f4e/volumes"
Jul 24 14:45:31.475001 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.474913    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cc6cf846f-48qxn"]
Jul 24 14:45:31.475393 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.475257    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b48da2b-c5d7-4237-954d-bbeb35311f4e" containerName="manager"
Jul 24 14:45:31.475393 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.475269    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b48da2b-c5d7-4237-954d-bbeb35311f4e" containerName="manager"
Jul 24 14:45:31.475393 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.475318    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b48da2b-c5d7-4237-954d-bbeb35311f4e" containerName="manager"
Jul 24 14:45:31.478092 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.478075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.482449 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.482423    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:45:31.482589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.482473    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:45:31.482687 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.482669    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jx5zn\""
Jul 24 14:45:31.491201 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.491180    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-48qxn"]
Jul 24 14:45:31.571636 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.571605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtshv\" (UniqueName: \"kubernetes.io/projected/e18e611f-ce5c-4c91-940a-41cc55e8f808-kube-api-access-jtshv\") pod \"maas-controller-cc6cf846f-48qxn\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") " pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.571781 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.571648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e18e611f-ce5c-4c91-940a-41cc55e8f808-webhook-cert\") pod \"maas-controller-cc6cf846f-48qxn\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") " pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.672940 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.672903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtshv\" (UniqueName: \"kubernetes.io/projected/e18e611f-ce5c-4c91-940a-41cc55e8f808-kube-api-access-jtshv\") pod \"maas-controller-cc6cf846f-48qxn\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") " pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.673105 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.672953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e18e611f-ce5c-4c91-940a-41cc55e8f808-webhook-cert\") pod \"maas-controller-cc6cf846f-48qxn\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") " pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.675303 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.675280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e18e611f-ce5c-4c91-940a-41cc55e8f808-webhook-cert\") pod \"maas-controller-cc6cf846f-48qxn\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") " pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.682136 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.682114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtshv\" (UniqueName: \"kubernetes.io/projected/e18e611f-ce5c-4c91-940a-41cc55e8f808-kube-api-access-jtshv\") pod \"maas-controller-cc6cf846f-48qxn\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") " pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.788373 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.788289    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:31.923223 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.923195    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-48qxn"]
Jul 24 14:45:31.924820 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:45:31.924762    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18e611f_ce5c_4c91_940a_41cc55e8f808.slice/crio-5a7bfbc8d6d2a4f38821a11b0bbedb7f8d3f105874cab39b7ef53d88bf84965d WatchSource:0}: Error finding container 5a7bfbc8d6d2a4f38821a11b0bbedb7f8d3f105874cab39b7ef53d88bf84965d: Status 404 returned error can't find the container with id 5a7bfbc8d6d2a4f38821a11b0bbedb7f8d3f105874cab39b7ef53d88bf84965d
Jul 24 14:45:31.959651 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:31.959619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-48qxn" event={"ID":"e18e611f-ce5c-4c91-940a-41cc55e8f808","Type":"ContainerStarted","Data":"5a7bfbc8d6d2a4f38821a11b0bbedb7f8d3f105874cab39b7ef53d88bf84965d"}
Jul 24 14:45:33.970625 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:33.970587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-48qxn" event={"ID":"e18e611f-ce5c-4c91-940a-41cc55e8f808","Type":"ContainerStarted","Data":"b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa"}
Jul 24 14:45:33.971064 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:33.970682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:33.989551 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:33.989509    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cc6cf846f-48qxn" podStartSLOduration=1.9757251089999999 podStartE2EDuration="2.989494019s" totalImagesPullingTime="1.01376891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:33.988919975 +0000 UTC m=+811.340765163" watchObservedRunningTime="2026-07-24 14:45:33.989494019 +0000 UTC m=+811.341339203"
Jul 24 14:45:44.977228 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:44.977199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:49.620317 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.620279    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-48qxn"]
Jul 24 14:45:49.620836 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.620563    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cc6cf846f-48qxn" podUID="e18e611f-ce5c-4c91-940a-41cc55e8f808" containerName="manager" containerID="cri-o://b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa" gracePeriod=30
Jul 24 14:45:49.865002 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.864978    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:49.942706 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.942668    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtshv\" (UniqueName: \"kubernetes.io/projected/e18e611f-ce5c-4c91-940a-41cc55e8f808-kube-api-access-jtshv\") pod \"e18e611f-ce5c-4c91-940a-41cc55e8f808\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") "
Jul 24 14:45:49.942892 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.942760    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e18e611f-ce5c-4c91-940a-41cc55e8f808-webhook-cert\") pod \"e18e611f-ce5c-4c91-940a-41cc55e8f808\" (UID: \"e18e611f-ce5c-4c91-940a-41cc55e8f808\") "
Jul 24 14:45:49.944721 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.944693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18e611f-ce5c-4c91-940a-41cc55e8f808-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e18e611f-ce5c-4c91-940a-41cc55e8f808" (UID: "e18e611f-ce5c-4c91-940a-41cc55e8f808"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:45:49.944721 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:49.944695    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18e611f-ce5c-4c91-940a-41cc55e8f808-kube-api-access-jtshv" (OuterVolumeSpecName: "kube-api-access-jtshv") pod "e18e611f-ce5c-4c91-940a-41cc55e8f808" (UID: "e18e611f-ce5c-4c91-940a-41cc55e8f808"). InnerVolumeSpecName "kube-api-access-jtshv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:45:50.044336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.044303    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtshv\" (UniqueName: \"kubernetes.io/projected/e18e611f-ce5c-4c91-940a-41cc55e8f808-kube-api-access-jtshv\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:45:50.044336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.044329    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e18e611f-ce5c-4c91-940a-41cc55e8f808-webhook-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:45:50.049710 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.049683    2580 generic.go:356] "Generic (PLEG): container finished" podID="e18e611f-ce5c-4c91-940a-41cc55e8f808" containerID="b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa" exitCode=0
Jul 24 14:45:50.049870 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.049722    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-48qxn"
Jul 24 14:45:50.049870 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.049772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-48qxn" event={"ID":"e18e611f-ce5c-4c91-940a-41cc55e8f808","Type":"ContainerDied","Data":"b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa"}
Jul 24 14:45:50.049870 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.049846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-48qxn" event={"ID":"e18e611f-ce5c-4c91-940a-41cc55e8f808","Type":"ContainerDied","Data":"5a7bfbc8d6d2a4f38821a11b0bbedb7f8d3f105874cab39b7ef53d88bf84965d"}
Jul 24 14:45:50.050053 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.049875    2580 scope.go:117] "RemoveContainer" containerID="b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa"
Jul 24 14:45:50.058734 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.058713    2580 scope.go:117] "RemoveContainer" containerID="b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa"
Jul 24 14:45:50.059047 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:45:50.059021    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa\": container with ID starting with b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa not found: ID does not exist" containerID="b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa"
Jul 24 14:45:50.059134 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.059055    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa"} err="failed to get container status \"b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa\": rpc error: code = NotFound desc = could not find container \"b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa\": container with ID starting with b18aef2d4067cf8bd341afd11c64541513420eb3fcc022583e677b3bd62573fa not found: ID does not exist"
Jul 24 14:45:50.071403 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.071380    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-48qxn"]
Jul 24 14:45:50.082152 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.082127    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-48qxn"]
Jul 24 14:45:50.879415 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.879377    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cc6cf846f-kxtk4"]
Jul 24 14:45:50.879832 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.879773    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18e611f-ce5c-4c91-940a-41cc55e8f808" containerName="manager"
Jul 24 14:45:50.879832 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.879800    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18e611f-ce5c-4c91-940a-41cc55e8f808" containerName="manager"
Jul 24 14:45:50.879924 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.879887    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18e611f-ce5c-4c91-940a-41cc55e8f808" containerName="manager"
Jul 24 14:45:50.884151 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.884128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:50.887541 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.887510    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:45:50.887541 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.887537    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:45:50.887706 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.887510    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jx5zn\""
Jul 24 14:45:50.894451 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.894432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-kxtk4"]
Jul 24 14:45:50.953513 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.953479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69tvj\" (UniqueName: \"kubernetes.io/projected/f9044750-7d05-444d-a409-5009fda86f2c-kube-api-access-69tvj\") pod \"maas-controller-cc6cf846f-kxtk4\" (UID: \"f9044750-7d05-444d-a409-5009fda86f2c\") " pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:50.953689 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:50.953534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9044750-7d05-444d-a409-5009fda86f2c-webhook-cert\") pod \"maas-controller-cc6cf846f-kxtk4\" (UID: \"f9044750-7d05-444d-a409-5009fda86f2c\") " pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:51.054392 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.054365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69tvj\" (UniqueName: \"kubernetes.io/projected/f9044750-7d05-444d-a409-5009fda86f2c-kube-api-access-69tvj\") pod \"maas-controller-cc6cf846f-kxtk4\" (UID: \"f9044750-7d05-444d-a409-5009fda86f2c\") " pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:51.054548 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.054419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9044750-7d05-444d-a409-5009fda86f2c-webhook-cert\") pod \"maas-controller-cc6cf846f-kxtk4\" (UID: \"f9044750-7d05-444d-a409-5009fda86f2c\") " pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:51.057011 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.056987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9044750-7d05-444d-a409-5009fda86f2c-webhook-cert\") pod \"maas-controller-cc6cf846f-kxtk4\" (UID: \"f9044750-7d05-444d-a409-5009fda86f2c\") " pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:51.063392 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.063372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69tvj\" (UniqueName: \"kubernetes.io/projected/f9044750-7d05-444d-a409-5009fda86f2c-kube-api-access-69tvj\") pod \"maas-controller-cc6cf846f-kxtk4\" (UID: \"f9044750-7d05-444d-a409-5009fda86f2c\") " pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:51.066253 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.066224    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18e611f-ce5c-4c91-940a-41cc55e8f808" path="/var/lib/kubelet/pods/e18e611f-ce5c-4c91-940a-41cc55e8f808/volumes"
Jul 24 14:45:51.195005 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.194972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:51.344430 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:51.344403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc6cf846f-kxtk4"]
Jul 24 14:45:51.345687 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:45:51.345659    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9044750_7d05_444d_a409_5009fda86f2c.slice/crio-18c8bae95a11deb356610d2cb108f1b671456c7a81faff565dec89f6fdf2c74c WatchSource:0}: Error finding container 18c8bae95a11deb356610d2cb108f1b671456c7a81faff565dec89f6fdf2c74c: Status 404 returned error can't find the container with id 18c8bae95a11deb356610d2cb108f1b671456c7a81faff565dec89f6fdf2c74c
Jul 24 14:45:52.062669 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:52.062566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-kxtk4" event={"ID":"f9044750-7d05-444d-a409-5009fda86f2c","Type":"ContainerStarted","Data":"89e519ec5bcc503ee25d15e9547427bfc089bbd0f58600a6734d86ec179fe0dc"}
Jul 24 14:45:52.062669 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:52.062621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc6cf846f-kxtk4" event={"ID":"f9044750-7d05-444d-a409-5009fda86f2c","Type":"ContainerStarted","Data":"18c8bae95a11deb356610d2cb108f1b671456c7a81faff565dec89f6fdf2c74c"}
Jul 24 14:45:52.063149 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:52.062670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:45:52.084119 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:45:52.084045    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cc6cf846f-kxtk4" podStartSLOduration=1.718770436 podStartE2EDuration="2.084028457s" totalImagesPullingTime="365.258021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:52.08151359 +0000 UTC m=+829.433358776" watchObservedRunningTime="2026-07-24 14:45:52.084028457 +0000 UTC m=+829.435873667"
Jul 24 14:46:03.070068 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:46:03.070031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cc6cf846f-kxtk4"
Jul 24 14:49:02.333185 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.333149    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d97676cc5-4jd9s"]
Jul 24 14:49:02.336715 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.336692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.360237 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.360206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d97676cc5-4jd9s"]
Jul 24 14:49:02.452034 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.451989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4278a54-163d-46be-accf-c5eeefebbda6-console-oauth-config\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.452238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.452048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqwt\" (UniqueName: \"kubernetes.io/projected/b4278a54-163d-46be-accf-c5eeefebbda6-kube-api-access-zcqwt\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.452238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.452108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4278a54-163d-46be-accf-c5eeefebbda6-console-serving-cert\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.452238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.452129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-service-ca\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.452238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.452174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-console-config\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.452238 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.452229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-trusted-ca-bundle\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.452462 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.452271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-oauth-serving-cert\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.552776 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-oauth-serving-cert\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.552776 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4278a54-163d-46be-accf-c5eeefebbda6-console-oauth-config\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553044 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqwt\" (UniqueName: \"kubernetes.io/projected/b4278a54-163d-46be-accf-c5eeefebbda6-kube-api-access-zcqwt\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553044 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4278a54-163d-46be-accf-c5eeefebbda6-console-serving-cert\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553044 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-service-ca\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553044 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-console-config\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553044 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.552935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-trusted-ca-bundle\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553646 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.553614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-oauth-serving-cert\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553811 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.553777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-trusted-ca-bundle\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553938 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.553685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-service-ca\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.553938 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.553749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4278a54-163d-46be-accf-c5eeefebbda6-console-config\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.555343 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.555321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4278a54-163d-46be-accf-c5eeefebbda6-console-oauth-config\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.555486 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.555465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4278a54-163d-46be-accf-c5eeefebbda6-console-serving-cert\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.561742 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.561720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqwt\" (UniqueName: \"kubernetes.io/projected/b4278a54-163d-46be-accf-c5eeefebbda6-kube-api-access-zcqwt\") pod \"console-7d97676cc5-4jd9s\" (UID: \"b4278a54-163d-46be-accf-c5eeefebbda6\") " pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.646464 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.646374    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:02.785942 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:02.785915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d97676cc5-4jd9s"]
Jul 24 14:49:02.788128 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:49:02.788101    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4278a54_163d_46be_accf_c5eeefebbda6.slice/crio-e9f10b2b8c1dde55d166e6b82098533ffa4a8f5b8131498313510bcba4bc957d WatchSource:0}: Error finding container e9f10b2b8c1dde55d166e6b82098533ffa4a8f5b8131498313510bcba4bc957d: Status 404 returned error can't find the container with id e9f10b2b8c1dde55d166e6b82098533ffa4a8f5b8131498313510bcba4bc957d
Jul 24 14:49:03.009092 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:03.009059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d97676cc5-4jd9s" event={"ID":"b4278a54-163d-46be-accf-c5eeefebbda6","Type":"ContainerStarted","Data":"e060590e331769105b1686736664b434e30d2911ef3ee586bddc4971e8b2ea77"}
Jul 24 14:49:03.009285 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:03.009113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d97676cc5-4jd9s" event={"ID":"b4278a54-163d-46be-accf-c5eeefebbda6","Type":"ContainerStarted","Data":"e9f10b2b8c1dde55d166e6b82098533ffa4a8f5b8131498313510bcba4bc957d"}
Jul 24 14:49:03.029516 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:03.029457    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d97676cc5-4jd9s" podStartSLOduration=1.029437965 podStartE2EDuration="1.029437965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:49:03.028039887 +0000 UTC m=+1020.379885073" watchObservedRunningTime="2026-07-24 14:49:03.029437965 +0000 UTC m=+1020.381283150"
Jul 24 14:49:12.646716 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:12.646622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:12.646716 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:12.646691    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:12.651488 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:12.651467    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:13.065400 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:13.065371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d97676cc5-4jd9s"
Jul 24 14:49:13.112589 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:13.112558    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69875f8889-jx2bb"]
Jul 24 14:49:38.132390 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.132338    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69875f8889-jx2bb" podUID="e332f361-0427-440d-8660-0166da58e83f" containerName="console" containerID="cri-o://a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e" gracePeriod=15
Jul 24 14:49:38.391356 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.391295    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:49:38.479628 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.479591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-oauth-serving-cert\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.479816 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.479658    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-oauth-config\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.479816 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.479709    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-trusted-ca-bundle\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.479816 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.479764    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-serving-cert\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.479996 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.479822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8lnx\" (UniqueName: \"kubernetes.io/projected/e332f361-0427-440d-8660-0166da58e83f-kube-api-access-k8lnx\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.479996 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.479896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-console-config\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.480120 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480093    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-service-ca\") pod \"e332f361-0427-440d-8660-0166da58e83f\" (UID: \"e332f361-0427-440d-8660-0166da58e83f\") "
Jul 24 14:49:38.480210 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480106    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:49:38.480283 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:49:38.480338 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480317    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-console-config" (OuterVolumeSpecName: "console-config") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:49:38.480392 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480366    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:49:38.480522 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480503    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-console-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:38.480582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480526    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:38.480582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480540    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-oauth-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:38.480582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.480556    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e332f361-0427-440d-8660-0166da58e83f-trusted-ca-bundle\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:38.481931 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.481894    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:49:38.482038 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.481963    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:49:38.482038 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.481976    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e332f361-0427-440d-8660-0166da58e83f-kube-api-access-k8lnx" (OuterVolumeSpecName: "kube-api-access-k8lnx") pod "e332f361-0427-440d-8660-0166da58e83f" (UID: "e332f361-0427-440d-8660-0166da58e83f"). InnerVolumeSpecName "kube-api-access-k8lnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:49:38.581679 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.581640    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-oauth-config\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:38.581679 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.581669    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e332f361-0427-440d-8660-0166da58e83f-console-serving-cert\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:38.581679 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:38.581683    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8lnx\" (UniqueName: \"kubernetes.io/projected/e332f361-0427-440d-8660-0166da58e83f-kube-api-access-k8lnx\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:49:39.195357 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.195317    2580 generic.go:356] "Generic (PLEG): container finished" podID="e332f361-0427-440d-8660-0166da58e83f" containerID="a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e" exitCode=0
Jul 24 14:49:39.195887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.195382    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69875f8889-jx2bb"
Jul 24 14:49:39.195887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.195401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69875f8889-jx2bb" event={"ID":"e332f361-0427-440d-8660-0166da58e83f","Type":"ContainerDied","Data":"a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e"}
Jul 24 14:49:39.195887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.195466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69875f8889-jx2bb" event={"ID":"e332f361-0427-440d-8660-0166da58e83f","Type":"ContainerDied","Data":"ba6871a9805faa71342087b206a82d845fa461cafb1adb2c3978c175cb1b2033"}
Jul 24 14:49:39.195887 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.195495    2580 scope.go:117] "RemoveContainer" containerID="a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e"
Jul 24 14:49:39.204012 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.203993    2580 scope.go:117] "RemoveContainer" containerID="a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e"
Jul 24 14:49:39.204307 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:49:39.204288    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e\": container with ID starting with a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e not found: ID does not exist" containerID="a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e"
Jul 24 14:49:39.204372 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.204316    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e"} err="failed to get container status \"a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e\": rpc error: code = NotFound desc = could not find container \"a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e\": container with ID starting with a64b62b85cb0aa073db1fa99d393fc3b9b34a693588942034e1763b11af5e02e not found: ID does not exist"
Jul 24 14:49:39.216289 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.216265    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69875f8889-jx2bb"]
Jul 24 14:49:39.220494 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:39.220473    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69875f8889-jx2bb"]
Jul 24 14:49:41.064983 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:49:41.064949    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e332f361-0427-440d-8660-0166da58e83f" path="/var/lib/kubelet/pods/e332f361-0427-440d-8660-0166da58e83f/volumes"
Jul 24 14:58:38.727937 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.727905    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"]
Jul 24 14:58:38.728431 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.728231    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e332f361-0427-440d-8660-0166da58e83f" containerName="console"
Jul 24 14:58:38.728431 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.728242    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e332f361-0427-440d-8660-0166da58e83f" containerName="console"
Jul 24 14:58:38.728431 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.728309    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e332f361-0427-440d-8660-0166da58e83f" containerName="console"
Jul 24 14:58:38.731569 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.731550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.734172 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.734151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-639b4a8c-serving-cert\""
Jul 24 14:58:38.743671 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.743649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"]
Jul 24 14:58:38.861439 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.861391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-openshift-service-ca\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.861619 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.861468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-maas-api-tls\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.861619 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.861490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkqw\" (UniqueName: \"kubernetes.io/projected/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-kube-api-access-jxkqw\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.962862 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.962784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-maas-api-tls\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.962862 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.962876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkqw\" (UniqueName: \"kubernetes.io/projected/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-kube-api-access-jxkqw\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.963140 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.962952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-openshift-service-ca\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.963602 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.963578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-openshift-service-ca\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.965299 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.965281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-maas-api-tls\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:38.971223 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:38.971191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkqw\" (UniqueName: \"kubernetes.io/projected/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-kube-api-access-jxkqw\") pod \"maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:39.042052 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.041968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:39.181854 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.181825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"]
Jul 24 14:58:39.183264 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:58:39.183225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccfeb6f_fe03_4ef9_9ddc_197eebe3a139.slice/crio-5555f44c086c46f8a82451a22d5f3563d66f68564dbb0ddaf011f9d8b3ebdf5f WatchSource:0}: Error finding container 5555f44c086c46f8a82451a22d5f3563d66f68564dbb0ddaf011f9d8b3ebdf5f: Status 404 returned error can't find the container with id 5555f44c086c46f8a82451a22d5f3563d66f68564dbb0ddaf011f9d8b3ebdf5f
Jul 24 14:58:39.184599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.184575    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:58:39.911315 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.911280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh" event={"ID":"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139","Type":"ContainerStarted","Data":"039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5"}
Jul 24 14:58:39.911704 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.911366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh" event={"ID":"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139","Type":"ContainerStarted","Data":"5555f44c086c46f8a82451a22d5f3563d66f68564dbb0ddaf011f9d8b3ebdf5f"}
Jul 24 14:58:39.911704 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.911485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:58:39.938325 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:39.938269    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh" podStartSLOduration=1.410092466 podStartE2EDuration="1.938253557s" totalImagesPullingTime="528.161091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:58:39.93549968 +0000 UTC m=+1597.287344867" watchObservedRunningTime="2026-07-24 14:58:39.938253557 +0000 UTC m=+1597.290098742"
Jul 24 14:58:45.921819 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:58:45.921770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:59:14.711856 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:14.711749    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"]
Jul 24 14:59:14.712426 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:14.712055    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh" podUID="6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" containerName="maas-api" containerID="cri-o://039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5" gracePeriod=30
Jul 24 14:59:14.754302 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:59:14.754251    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccfeb6f_fe03_4ef9_9ddc_197eebe3a139.slice/crio-039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 14:59:14.966201 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:14.966142    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:59:15.089105 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.089073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-maas-api-tls\") pod \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") "
Jul 24 14:59:15.089279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.089171    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkqw\" (UniqueName: \"kubernetes.io/projected/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-kube-api-access-jxkqw\") pod \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") "
Jul 24 14:59:15.089279 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.089257    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-openshift-service-ca\") pod \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\" (UID: \"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139\") "
Jul 24 14:59:15.089783 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.089673    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" (UID: "6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:15.090599 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.090571    2580 generic.go:356] "Generic (PLEG): container finished" podID="6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" containerID="039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5" exitCode=0
Jul 24 14:59:15.090702 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.090619    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"
Jul 24 14:59:15.090702 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.090639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh" event={"ID":"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139","Type":"ContainerDied","Data":"039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5"}
Jul 24 14:59:15.090702 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.090691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh" event={"ID":"6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139","Type":"ContainerDied","Data":"5555f44c086c46f8a82451a22d5f3563d66f68564dbb0ddaf011f9d8b3ebdf5f"}
Jul 24 14:59:15.090851 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.090724    2580 scope.go:117] "RemoveContainer" containerID="039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5"
Jul 24 14:59:15.091964 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.091945    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" (UID: "6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:15.092025 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.091947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-kube-api-access-jxkqw" (OuterVolumeSpecName: "kube-api-access-jxkqw") pod "6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" (UID: "6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139"). InnerVolumeSpecName "kube-api-access-jxkqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:59:15.104378 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.104362    2580 scope.go:117] "RemoveContainer" containerID="039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5"
Jul 24 14:59:15.104677 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:59:15.104652    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5\": container with ID starting with 039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5 not found: ID does not exist" containerID="039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5"
Jul 24 14:59:15.104738 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.104687    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5"} err="failed to get container status \"039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5\": rpc error: code = NotFound desc = could not find container \"039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5\": container with ID starting with 039d44428250fc448464192ac01c9372ea206ca1199bc219885fd02e4a3b00c5 not found: ID does not exist"
Jul 24 14:59:15.190014 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.189981    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkqw\" (UniqueName: \"kubernetes.io/projected/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-kube-api-access-jxkqw\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:15.190014 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.190007    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:15.190014 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.190019    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:15.426710 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.426679    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"]
Jul 24 14:59:15.432475 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:15.432449    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639b4a8c-84d5b584b5-jhhvh"]
Jul 24 14:59:17.065650 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:17.065619    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" path="/var/lib/kubelet/pods/6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139/volumes"
Jul 24 14:59:23.101410 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.098301    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"]
Jul 24 14:59:23.101410 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.099052    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" containerName="maas-api"
Jul 24 14:59:23.101410 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.099072    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" containerName="maas-api"
Jul 24 14:59:23.101410 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.099247    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ccfeb6f-fe03-4ef9-9ddc-197eebe3a139" containerName="maas-api"
Jul 24 14:59:23.103133 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.103044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.106289 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.106272    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5084c046-serving-cert\""
Jul 24 14:59:23.116433 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.116410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"]
Jul 24 14:59:23.165094 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.165063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q7l9\" (UniqueName: \"kubernetes.io/projected/a650ca54-8e20-4b2c-98b9-2cb236630177-kube-api-access-4q7l9\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.165308 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.165207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a650ca54-8e20-4b2c-98b9-2cb236630177-openshift-service-ca\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.165308 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.165277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.266534 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.266494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a650ca54-8e20-4b2c-98b9-2cb236630177-openshift-service-ca\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.266727 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.266568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.266727 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.266611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q7l9\" (UniqueName: \"kubernetes.io/projected/a650ca54-8e20-4b2c-98b9-2cb236630177-kube-api-access-4q7l9\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.266853 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:59:23.266740    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-serving-cert: secret "maas-api-e2e-migrate-5084c046-serving-cert" not found
Jul 24 14:59:23.266853 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:59:23.266842    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls podName:a650ca54-8e20-4b2c-98b9-2cb236630177 nodeName:}" failed. No retries permitted until 2026-07-24 14:59:23.76682023 +0000 UTC m=+1641.118665413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls") pod "maas-api-e2e-migrate-5084c046-b44579774-v9w7d" (UID: "a650ca54-8e20-4b2c-98b9-2cb236630177") : secret "maas-api-e2e-migrate-5084c046-serving-cert" not found
Jul 24 14:59:23.267285 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.267262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a650ca54-8e20-4b2c-98b9-2cb236630177-openshift-service-ca\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.288059 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.288023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q7l9\" (UniqueName: \"kubernetes.io/projected/a650ca54-8e20-4b2c-98b9-2cb236630177-kube-api-access-4q7l9\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.771282 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.771240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:23.773637 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:23.773612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls\") pod \"maas-api-e2e-migrate-5084c046-b44579774-v9w7d\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:24.013480 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.013448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:24.095564 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.095535    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"]
Jul 24 14:59:24.099184 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.099129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.112717 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.112637    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-5084c046\""
Jul 24 14:59:24.114009 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.113982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"]
Jul 24 14:59:24.176146 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.176108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns7zl\" (UniqueName: \"kubernetes.io/projected/eb06f9cb-690b-4266-91a6-454694a762fa-kube-api-access-ns7zl\") pod \"payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.176146 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.176162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb06f9cb-690b-4266-91a6-454694a762fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.180302 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.180279    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"]
Jul 24 14:59:24.182081 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:59:24.182054    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda650ca54_8e20_4b2c_98b9_2cb236630177.slice/crio-1b684d4811197e424ca62f13486cc068d4394e8d4266ce8cd2555db13996df93 WatchSource:0}: Error finding container 1b684d4811197e424ca62f13486cc068d4394e8d4266ce8cd2555db13996df93: Status 404 returned error can't find the container with id 1b684d4811197e424ca62f13486cc068d4394e8d4266ce8cd2555db13996df93
Jul 24 14:59:24.277573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.277487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns7zl\" (UniqueName: \"kubernetes.io/projected/eb06f9cb-690b-4266-91a6-454694a762fa-kube-api-access-ns7zl\") pod \"payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.277573 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.277537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb06f9cb-690b-4266-91a6-454694a762fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.278225 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.278204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb06f9cb-690b-4266-91a6-454694a762fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.286891 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.286860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns7zl\" (UniqueName: \"kubernetes.io/projected/eb06f9cb-690b-4266-91a6-454694a762fa-kube-api-access-ns7zl\") pod \"payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.413430 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.413382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:24.551532 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:24.551506    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"]
Jul 24 14:59:24.553316 ip-10-0-140-168 kubenswrapper[2580]: W0724 14:59:24.553290    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb06f9cb_690b_4266_91a6_454694a762fa.slice/crio-a54769d581afa49a8033959942cea13b2081026123f8604a6639b16f1b133b33 WatchSource:0}: Error finding container a54769d581afa49a8033959942cea13b2081026123f8604a6639b16f1b133b33: Status 404 returned error can't find the container with id a54769d581afa49a8033959942cea13b2081026123f8604a6639b16f1b133b33
Jul 24 14:59:25.145804 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.145765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn" event={"ID":"eb06f9cb-690b-4266-91a6-454694a762fa","Type":"ContainerStarted","Data":"e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd"}
Jul 24 14:59:25.146281 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.145838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn" event={"ID":"eb06f9cb-690b-4266-91a6-454694a762fa","Type":"ContainerStarted","Data":"a54769d581afa49a8033959942cea13b2081026123f8604a6639b16f1b133b33"}
Jul 24 14:59:25.146281 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.145885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:25.147336 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.147309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d" event={"ID":"a650ca54-8e20-4b2c-98b9-2cb236630177","Type":"ContainerStarted","Data":"5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42"}
Jul 24 14:59:25.147449 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.147356    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d" event={"ID":"a650ca54-8e20-4b2c-98b9-2cb236630177","Type":"ContainerStarted","Data":"1b684d4811197e424ca62f13486cc068d4394e8d4266ce8cd2555db13996df93"}
Jul 24 14:59:25.147449 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.147381    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:25.163428 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.163384    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn" podStartSLOduration=1.163371017 podStartE2EDuration="1.163371017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:59:25.162353409 +0000 UTC m=+1642.514198615" watchObservedRunningTime="2026-07-24 14:59:25.163371017 +0000 UTC m=+1642.515216241"
Jul 24 14:59:25.180401 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:25.180352    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d" podStartSLOduration=1.834728111 podStartE2EDuration="2.180335965s" totalImagesPullingTime="345.607854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:59:25.179552255 +0000 UTC m=+1642.531397437" watchObservedRunningTime="2026-07-24 14:59:25.180335965 +0000 UTC m=+1642.532181151"
Jul 24 14:59:31.158491 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:31.158461    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:36.155523 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:36.155490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:58.495217 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.495180    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"]
Jul 24 14:59:58.495665 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.495383    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d" podUID="a650ca54-8e20-4b2c-98b9-2cb236630177" containerName="maas-api" containerID="cri-o://5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42" gracePeriod=30
Jul 24 14:59:58.586962 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.586919    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"]
Jul 24 14:59:58.587205 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.587172    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn" podUID="eb06f9cb-690b-4266-91a6-454694a762fa" containerName="payload-pre-processing" containerID="cri-o://e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd" gracePeriod=30
Jul 24 14:59:58.834617 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.834594    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:58.863987 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.863960    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:58.887700 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.887662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls\") pod \"a650ca54-8e20-4b2c-98b9-2cb236630177\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") "
Jul 24 14:59:58.887910 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.887730    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q7l9\" (UniqueName: \"kubernetes.io/projected/a650ca54-8e20-4b2c-98b9-2cb236630177-kube-api-access-4q7l9\") pod \"a650ca54-8e20-4b2c-98b9-2cb236630177\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") "
Jul 24 14:59:58.887910 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.887821    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a650ca54-8e20-4b2c-98b9-2cb236630177-openshift-service-ca\") pod \"a650ca54-8e20-4b2c-98b9-2cb236630177\" (UID: \"a650ca54-8e20-4b2c-98b9-2cb236630177\") "
Jul 24 14:59:58.895021 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.894978    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a650ca54-8e20-4b2c-98b9-2cb236630177-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a650ca54-8e20-4b2c-98b9-2cb236630177" (UID: "a650ca54-8e20-4b2c-98b9-2cb236630177"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:58.895181 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.895031    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a650ca54-8e20-4b2c-98b9-2cb236630177" (UID: "a650ca54-8e20-4b2c-98b9-2cb236630177"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:58.896708 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.896681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a650ca54-8e20-4b2c-98b9-2cb236630177-kube-api-access-4q7l9" (OuterVolumeSpecName: "kube-api-access-4q7l9") pod "a650ca54-8e20-4b2c-98b9-2cb236630177" (UID: "a650ca54-8e20-4b2c-98b9-2cb236630177"). InnerVolumeSpecName "kube-api-access-4q7l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:59:58.995331 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.995295    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb06f9cb-690b-4266-91a6-454694a762fa-plugins-config-volume\") pod \"eb06f9cb-690b-4266-91a6-454694a762fa\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") "
Jul 24 14:59:58.995513 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.995339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns7zl\" (UniqueName: \"kubernetes.io/projected/eb06f9cb-690b-4266-91a6-454694a762fa-kube-api-access-ns7zl\") pod \"eb06f9cb-690b-4266-91a6-454694a762fa\" (UID: \"eb06f9cb-690b-4266-91a6-454694a762fa\") "
Jul 24 14:59:58.995582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.995553    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a650ca54-8e20-4b2c-98b9-2cb236630177-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:58.995582 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.995573    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q7l9\" (UniqueName: \"kubernetes.io/projected/a650ca54-8e20-4b2c-98b9-2cb236630177-kube-api-access-4q7l9\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:58.995677 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.995588    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a650ca54-8e20-4b2c-98b9-2cb236630177-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:58.995677 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.995629    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb06f9cb-690b-4266-91a6-454694a762fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb06f9cb-690b-4266-91a6-454694a762fa" (UID: "eb06f9cb-690b-4266-91a6-454694a762fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:59:58.997332 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:58.997310    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb06f9cb-690b-4266-91a6-454694a762fa-kube-api-access-ns7zl" (OuterVolumeSpecName: "kube-api-access-ns7zl") pod "eb06f9cb-690b-4266-91a6-454694a762fa" (UID: "eb06f9cb-690b-4266-91a6-454694a762fa"). InnerVolumeSpecName "kube-api-access-ns7zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:59:59.096280 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.096246    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb06f9cb-690b-4266-91a6-454694a762fa-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:59.096280 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.096273    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns7zl\" (UniqueName: \"kubernetes.io/projected/eb06f9cb-690b-4266-91a6-454694a762fa-kube-api-access-ns7zl\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 14:59:59.329868 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.329751    2580 generic.go:356] "Generic (PLEG): container finished" podID="eb06f9cb-690b-4266-91a6-454694a762fa" containerID="e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd" exitCode=0
Jul 24 14:59:59.329868 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.329819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn" event={"ID":"eb06f9cb-690b-4266-91a6-454694a762fa","Type":"ContainerDied","Data":"e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd"}
Jul 24 14:59:59.329868 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.329834    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"
Jul 24 14:59:59.330105 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.329873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn" event={"ID":"eb06f9cb-690b-4266-91a6-454694a762fa","Type":"ContainerDied","Data":"a54769d581afa49a8033959942cea13b2081026123f8604a6639b16f1b133b33"}
Jul 24 14:59:59.330105 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.329896    2580 scope.go:117] "RemoveContainer" containerID="e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd"
Jul 24 14:59:59.331299 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.331269    2580 generic.go:356] "Generic (PLEG): container finished" podID="a650ca54-8e20-4b2c-98b9-2cb236630177" containerID="5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42" exitCode=0
Jul 24 14:59:59.331408 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.331298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d" event={"ID":"a650ca54-8e20-4b2c-98b9-2cb236630177","Type":"ContainerDied","Data":"5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42"}
Jul 24 14:59:59.331408 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.331342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d" event={"ID":"a650ca54-8e20-4b2c-98b9-2cb236630177","Type":"ContainerDied","Data":"1b684d4811197e424ca62f13486cc068d4394e8d4266ce8cd2555db13996df93"}
Jul 24 14:59:59.331408 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.331346    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"
Jul 24 14:59:59.338851 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.338834    2580 scope.go:117] "RemoveContainer" containerID="e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd"
Jul 24 14:59:59.339137 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:59:59.339118    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd\": container with ID starting with e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd not found: ID does not exist" containerID="e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd"
Jul 24 14:59:59.339212 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.339145    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd"} err="failed to get container status \"e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd\": rpc error: code = NotFound desc = could not find container \"e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd\": container with ID starting with e079a9921089b759d737f1516255b2d3537fba56cbe8cdebf61b17bf932343cd not found: ID does not exist"
Jul 24 14:59:59.339212 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.339164    2580 scope.go:117] "RemoveContainer" containerID="5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42"
Jul 24 14:59:59.347451 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.347436    2580 scope.go:117] "RemoveContainer" containerID="5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42"
Jul 24 14:59:59.347687 ip-10-0-140-168 kubenswrapper[2580]: E0724 14:59:59.347668    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42\": container with ID starting with 5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42 not found: ID does not exist" containerID="5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42"
Jul 24 14:59:59.347730 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.347694    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42"} err="failed to get container status \"5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42\": rpc error: code = NotFound desc = could not find container \"5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42\": container with ID starting with 5e66b2cb41470c8fb375c21559c5d17dbe046396e439cd62874af21e685f9b42 not found: ID does not exist"
Jul 24 14:59:59.363345 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.363322    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"]
Jul 24 14:59:59.370206 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.370183    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5084c046-b44579774-v9w7d"]
Jul 24 14:59:59.389345 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.389314    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"]
Jul 24 14:59:59.391314 ip-10-0-140-168 kubenswrapper[2580]: I0724 14:59:59.391295    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5084c046-67dd8cb9d4-pqsqn"]
Jul 24 15:00:01.064514 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:01.064482    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a650ca54-8e20-4b2c-98b9-2cb236630177" path="/var/lib/kubelet/pods/a650ca54-8e20-4b2c-98b9-2cb236630177/volumes"
Jul 24 15:00:01.064902 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:01.064847    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb06f9cb-690b-4266-91a6-454694a762fa" path="/var/lib/kubelet/pods/eb06f9cb-690b-4266-91a6-454694a762fa/volumes"
Jul 24 15:00:06.224737 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.224690    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"]
Jul 24 15:00:06.225229 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.225187    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb06f9cb-690b-4266-91a6-454694a762fa" containerName="payload-pre-processing"
Jul 24 15:00:06.225229 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.225204    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb06f9cb-690b-4266-91a6-454694a762fa" containerName="payload-pre-processing"
Jul 24 15:00:06.225229 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.225220    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a650ca54-8e20-4b2c-98b9-2cb236630177" containerName="maas-api"
Jul 24 15:00:06.225229 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.225227    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a650ca54-8e20-4b2c-98b9-2cb236630177" containerName="maas-api"
Jul 24 15:00:06.225423 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.225293    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a650ca54-8e20-4b2c-98b9-2cb236630177" containerName="maas-api"
Jul 24 15:00:06.225423 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.225303    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb06f9cb-690b-4266-91a6-454694a762fa" containerName="payload-pre-processing"
Jul 24 15:00:06.229290 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.229274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.236257 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.236234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4c7371ad-serving-cert\""
Jul 24 15:00:06.245183 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.245156    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"]
Jul 24 15:00:06.365215 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.365180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96fbh\" (UniqueName: \"kubernetes.io/projected/f8048563-6cc8-44e6-b352-9ea13b74b2cf-kube-api-access-96fbh\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.365410 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.365235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8048563-6cc8-44e6-b352-9ea13b74b2cf-openshift-service-ca\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.365410 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.365290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8048563-6cc8-44e6-b352-9ea13b74b2cf-maas-api-tls\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.466388 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.466349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8048563-6cc8-44e6-b352-9ea13b74b2cf-maas-api-tls\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.466590 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.466423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96fbh\" (UniqueName: \"kubernetes.io/projected/f8048563-6cc8-44e6-b352-9ea13b74b2cf-kube-api-access-96fbh\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.466590 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.466466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8048563-6cc8-44e6-b352-9ea13b74b2cf-openshift-service-ca\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.467128 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.467109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8048563-6cc8-44e6-b352-9ea13b74b2cf-openshift-service-ca\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.468707 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.468685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8048563-6cc8-44e6-b352-9ea13b74b2cf-maas-api-tls\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.477158 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.477095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96fbh\" (UniqueName: \"kubernetes.io/projected/f8048563-6cc8-44e6-b352-9ea13b74b2cf-kube-api-access-96fbh\") pod \"maas-api-e2e-ait-4c7371ad-76954c568f-67l5z\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.539953 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.539916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:06.684740 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:06.684715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"]
Jul 24 15:00:06.686645 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:00:06.686613    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8048563_6cc8_44e6_b352_9ea13b74b2cf.slice/crio-1ad9709a77169aaf6509117ab5456c49c545efcf95e9c6b6d3b58f926c8d1459 WatchSource:0}: Error finding container 1ad9709a77169aaf6509117ab5456c49c545efcf95e9c6b6d3b58f926c8d1459: Status 404 returned error can't find the container with id 1ad9709a77169aaf6509117ab5456c49c545efcf95e9c6b6d3b58f926c8d1459
Jul 24 15:00:07.375768 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:07.375689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z" event={"ID":"f8048563-6cc8-44e6-b352-9ea13b74b2cf","Type":"ContainerStarted","Data":"c64fcfccf23f29b1f5d2ff80f248847afd6bd0ca1808bad995529196f547b44a"}
Jul 24 15:00:07.375768 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:07.375743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z" event={"ID":"f8048563-6cc8-44e6-b352-9ea13b74b2cf","Type":"ContainerStarted","Data":"1ad9709a77169aaf6509117ab5456c49c545efcf95e9c6b6d3b58f926c8d1459"}
Jul 24 15:00:07.376251 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:07.375823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:07.397182 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:07.397119    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z" podStartSLOduration=1.039216525 podStartE2EDuration="1.397096756s" totalImagesPullingTime="357.880231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:07.396333003 +0000 UTC m=+1684.748178189" watchObservedRunningTime="2026-07-24 15:00:07.397096756 +0000 UTC m=+1684.748941942"
Jul 24 15:00:13.386738 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:13.386709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:42.423753 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.423716    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"]
Jul 24 15:00:42.424420 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.424164    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z" podUID="f8048563-6cc8-44e6-b352-9ea13b74b2cf" containerName="maas-api" containerID="cri-o://c64fcfccf23f29b1f5d2ff80f248847afd6bd0ca1808bad995529196f547b44a" gracePeriod=30
Jul 24 15:00:42.553200 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.553165    2580 generic.go:356] "Generic (PLEG): container finished" podID="f8048563-6cc8-44e6-b352-9ea13b74b2cf" containerID="c64fcfccf23f29b1f5d2ff80f248847afd6bd0ca1808bad995529196f547b44a" exitCode=0
Jul 24 15:00:42.553372 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.553201    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z" event={"ID":"f8048563-6cc8-44e6-b352-9ea13b74b2cf","Type":"ContainerDied","Data":"c64fcfccf23f29b1f5d2ff80f248847afd6bd0ca1808bad995529196f547b44a"}
Jul 24 15:00:42.675572 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.675497    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:42.779695 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.779656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8048563-6cc8-44e6-b352-9ea13b74b2cf-openshift-service-ca\") pod \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") "
Jul 24 15:00:42.779905 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.779707    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96fbh\" (UniqueName: \"kubernetes.io/projected/f8048563-6cc8-44e6-b352-9ea13b74b2cf-kube-api-access-96fbh\") pod \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") "
Jul 24 15:00:42.779905 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.779767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8048563-6cc8-44e6-b352-9ea13b74b2cf-maas-api-tls\") pod \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\" (UID: \"f8048563-6cc8-44e6-b352-9ea13b74b2cf\") "
Jul 24 15:00:42.780156 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.780130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8048563-6cc8-44e6-b352-9ea13b74b2cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8048563-6cc8-44e6-b352-9ea13b74b2cf" (UID: "f8048563-6cc8-44e6-b352-9ea13b74b2cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:00:42.781969 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.781944    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8048563-6cc8-44e6-b352-9ea13b74b2cf-kube-api-access-96fbh" (OuterVolumeSpecName: "kube-api-access-96fbh") pod "f8048563-6cc8-44e6-b352-9ea13b74b2cf" (UID: "f8048563-6cc8-44e6-b352-9ea13b74b2cf"). InnerVolumeSpecName "kube-api-access-96fbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:00:42.782052 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.781994    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8048563-6cc8-44e6-b352-9ea13b74b2cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8048563-6cc8-44e6-b352-9ea13b74b2cf" (UID: "f8048563-6cc8-44e6-b352-9ea13b74b2cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:00:42.880689 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.880657    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8048563-6cc8-44e6-b352-9ea13b74b2cf-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:00:42.880689 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.880683    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96fbh\" (UniqueName: \"kubernetes.io/projected/f8048563-6cc8-44e6-b352-9ea13b74b2cf-kube-api-access-96fbh\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:00:42.880689 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:42.880695    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8048563-6cc8-44e6-b352-9ea13b74b2cf-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:00:43.559383 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:43.559355    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"
Jul 24 15:00:43.559776 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:43.559359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z" event={"ID":"f8048563-6cc8-44e6-b352-9ea13b74b2cf","Type":"ContainerDied","Data":"1ad9709a77169aaf6509117ab5456c49c545efcf95e9c6b6d3b58f926c8d1459"}
Jul 24 15:00:43.559776 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:43.559490    2580 scope.go:117] "RemoveContainer" containerID="c64fcfccf23f29b1f5d2ff80f248847afd6bd0ca1808bad995529196f547b44a"
Jul 24 15:00:43.578864 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:43.578837    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"]
Jul 24 15:00:43.585988 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:43.585953    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c7371ad-76954c568f-67l5z"]
Jul 24 15:00:45.064346 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:45.064315    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8048563-6cc8-44e6-b352-9ea13b74b2cf" path="/var/lib/kubelet/pods/f8048563-6cc8-44e6-b352-9ea13b74b2cf/volumes"
Jul 24 15:00:51.525271 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.525241    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"]
Jul 24 15:00:51.525718 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.525566    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8048563-6cc8-44e6-b352-9ea13b74b2cf" containerName="maas-api"
Jul 24 15:00:51.525718 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.525576    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8048563-6cc8-44e6-b352-9ea13b74b2cf" containerName="maas-api"
Jul 24 15:00:51.525718 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.525636    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8048563-6cc8-44e6-b352-9ea13b74b2cf" containerName="maas-api"
Jul 24 15:00:51.528294 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.528277    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.531557 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.531533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2feafa84-serving-cert\""
Jul 24 15:00:51.542861 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.542835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"]
Jul 24 15:00:51.662426 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.662388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hszh\" (UniqueName: \"kubernetes.io/projected/6d791ca4-deb1-4a3d-b491-36c74834c6c8-kube-api-access-2hszh\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.662426 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.662428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d791ca4-deb1-4a3d-b491-36c74834c6c8-maas-api-tls\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.662693 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.662563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d791ca4-deb1-4a3d-b491-36c74834c6c8-openshift-service-ca\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.763184 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.763147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hszh\" (UniqueName: \"kubernetes.io/projected/6d791ca4-deb1-4a3d-b491-36c74834c6c8-kube-api-access-2hszh\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.763184 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.763188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d791ca4-deb1-4a3d-b491-36c74834c6c8-maas-api-tls\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.763403 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.763252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d791ca4-deb1-4a3d-b491-36c74834c6c8-openshift-service-ca\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.764009 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.763986    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d791ca4-deb1-4a3d-b491-36c74834c6c8-openshift-service-ca\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.765713 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.765687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d791ca4-deb1-4a3d-b491-36c74834c6c8-maas-api-tls\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.777461 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.777393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hszh\" (UniqueName: \"kubernetes.io/projected/6d791ca4-deb1-4a3d-b491-36c74834c6c8-kube-api-access-2hszh\") pod \"maas-api-e2e-derive-2feafa84-7977867cff-qpjsp\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.838711 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.838674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:51.980860 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:00:51.980832    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d791ca4_deb1_4a3d_b491_36c74834c6c8.slice/crio-28dda41632e2b013d82021d46272edd01ce2667051c9a86dbc6dea02a23835d4 WatchSource:0}: Error finding container 28dda41632e2b013d82021d46272edd01ce2667051c9a86dbc6dea02a23835d4: Status 404 returned error can't find the container with id 28dda41632e2b013d82021d46272edd01ce2667051c9a86dbc6dea02a23835d4
Jul 24 15:00:51.981292 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:51.981268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"]
Jul 24 15:00:52.507250 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.507214    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"]
Jul 24 15:00:52.509985 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.509969    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.515287 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.515265    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2feafa84-dockercfg-7x75w\""
Jul 24 15:00:52.515802 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.515766    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2feafa84\""
Jul 24 15:00:52.526506 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.526472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"]
Jul 24 15:00:52.570681 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.570649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5fdc5c-010a-45f6-9134-af288d22dd9f-plugins-config-volume\") pod \"payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") " pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.570880 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.570703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2b9k\" (UniqueName: \"kubernetes.io/projected/9b5fdc5c-010a-45f6-9134-af288d22dd9f-kube-api-access-s2b9k\") pod \"payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") " pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.605470 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.605435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp" event={"ID":"6d791ca4-deb1-4a3d-b491-36c74834c6c8","Type":"ContainerStarted","Data":"28dda41632e2b013d82021d46272edd01ce2667051c9a86dbc6dea02a23835d4"}
Jul 24 15:00:52.671705 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.671676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5fdc5c-010a-45f6-9134-af288d22dd9f-plugins-config-volume\") pod \"payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") " pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.671885 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.671722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2b9k\" (UniqueName: \"kubernetes.io/projected/9b5fdc5c-010a-45f6-9134-af288d22dd9f-kube-api-access-s2b9k\") pod \"payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") " pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.672391 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.672370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5fdc5c-010a-45f6-9134-af288d22dd9f-plugins-config-volume\") pod \"payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") " pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.686703 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.686670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2b9k\" (UniqueName: \"kubernetes.io/projected/9b5fdc5c-010a-45f6-9134-af288d22dd9f-kube-api-access-s2b9k\") pod \"payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") " pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.821532 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.821432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:52.994207 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:52.994184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"]
Jul 24 15:00:52.995832 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:00:52.995802    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5fdc5c_010a_45f6_9134_af288d22dd9f.slice/crio-01d7a2f7b52333624ac4ec90e583e2b2fd35db768a91b914c6f5933cf5c1868a WatchSource:0}: Error finding container 01d7a2f7b52333624ac4ec90e583e2b2fd35db768a91b914c6f5933cf5c1868a: Status 404 returned error can't find the container with id 01d7a2f7b52333624ac4ec90e583e2b2fd35db768a91b914c6f5933cf5c1868a
Jul 24 15:00:53.612578 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.612529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp" event={"ID":"6d791ca4-deb1-4a3d-b491-36c74834c6c8","Type":"ContainerStarted","Data":"125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7"}
Jul 24 15:00:53.613010 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.612596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:00:53.613955 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.613936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz" event={"ID":"9b5fdc5c-010a-45f6-9134-af288d22dd9f","Type":"ContainerStarted","Data":"21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369"}
Jul 24 15:00:53.614053 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.613974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz" event={"ID":"9b5fdc5c-010a-45f6-9134-af288d22dd9f","Type":"ContainerStarted","Data":"01d7a2f7b52333624ac4ec90e583e2b2fd35db768a91b914c6f5933cf5c1868a"}
Jul 24 15:00:53.614053 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.614005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:00:53.693124 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.693072    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp" podStartSLOduration=1.771838511 podStartE2EDuration="2.693055332s" totalImagesPullingTime="921.216821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:53.68551595 +0000 UTC m=+1731.037361139" watchObservedRunningTime="2026-07-24 15:00:53.693055332 +0000 UTC m=+1731.044900516"
Jul 24 15:00:53.723464 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:53.723411    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz" podStartSLOduration=1.723395027 podStartE2EDuration="1.723395027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:53.720820423 +0000 UTC m=+1731.072665606" watchObservedRunningTime="2026-07-24 15:00:53.723395027 +0000 UTC m=+1731.075240269"
Jul 24 15:00:59.624003 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:00:59.623972    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:01:04.620432 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:04.620401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:01:27.148206 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.148164    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"]
Jul 24 15:01:27.148752 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.148372    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp" podUID="6d791ca4-deb1-4a3d-b491-36c74834c6c8" containerName="maas-api" containerID="cri-o://125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7" gracePeriod=30
Jul 24 15:01:27.220120 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.220076    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"]
Jul 24 15:01:27.220365 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.220335    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz" podUID="9b5fdc5c-010a-45f6-9134-af288d22dd9f" containerName="payload-processing" containerID="cri-o://21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369" gracePeriod=30
Jul 24 15:01:27.483869 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.483838    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:01:27.486909 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.486885    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:01:27.589316 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hszh\" (UniqueName: \"kubernetes.io/projected/6d791ca4-deb1-4a3d-b491-36c74834c6c8-kube-api-access-2hszh\") pod \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") "
Jul 24 15:01:27.589316 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5fdc5c-010a-45f6-9134-af288d22dd9f-plugins-config-volume\") pod \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") "
Jul 24 15:01:27.589587 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d791ca4-deb1-4a3d-b491-36c74834c6c8-maas-api-tls\") pod \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") "
Jul 24 15:01:27.589587 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d791ca4-deb1-4a3d-b491-36c74834c6c8-openshift-service-ca\") pod \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\" (UID: \"6d791ca4-deb1-4a3d-b491-36c74834c6c8\") "
Jul 24 15:01:27.589587 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2b9k\" (UniqueName: \"kubernetes.io/projected/9b5fdc5c-010a-45f6-9134-af288d22dd9f-kube-api-access-s2b9k\") pod \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\" (UID: \"9b5fdc5c-010a-45f6-9134-af288d22dd9f\") "
Jul 24 15:01:27.589764 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589742    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5fdc5c-010a-45f6-9134-af288d22dd9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b5fdc5c-010a-45f6-9134-af288d22dd9f" (UID: "9b5fdc5c-010a-45f6-9134-af288d22dd9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:01:27.589845 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.589767    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d791ca4-deb1-4a3d-b491-36c74834c6c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d791ca4-deb1-4a3d-b491-36c74834c6c8" (UID: "6d791ca4-deb1-4a3d-b491-36c74834c6c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:01:27.591515 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.591484    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5fdc5c-010a-45f6-9134-af288d22dd9f-kube-api-access-s2b9k" (OuterVolumeSpecName: "kube-api-access-s2b9k") pod "9b5fdc5c-010a-45f6-9134-af288d22dd9f" (UID: "9b5fdc5c-010a-45f6-9134-af288d22dd9f"). InnerVolumeSpecName "kube-api-access-s2b9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:01:27.591515 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.591508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d791ca4-deb1-4a3d-b491-36c74834c6c8-kube-api-access-2hszh" (OuterVolumeSpecName: "kube-api-access-2hszh") pod "6d791ca4-deb1-4a3d-b491-36c74834c6c8" (UID: "6d791ca4-deb1-4a3d-b491-36c74834c6c8"). InnerVolumeSpecName "kube-api-access-2hszh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:01:27.591659 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.591511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d791ca4-deb1-4a3d-b491-36c74834c6c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d791ca4-deb1-4a3d-b491-36c74834c6c8" (UID: "6d791ca4-deb1-4a3d-b491-36c74834c6c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:01:27.690863 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.690758    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hszh\" (UniqueName: \"kubernetes.io/projected/6d791ca4-deb1-4a3d-b491-36c74834c6c8-kube-api-access-2hszh\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:01:27.690863 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.690784    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5fdc5c-010a-45f6-9134-af288d22dd9f-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:01:27.690863 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.690845    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d791ca4-deb1-4a3d-b491-36c74834c6c8-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:01:27.690863 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.690855    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d791ca4-deb1-4a3d-b491-36c74834c6c8-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:01:27.690863 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.690863    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2b9k\" (UniqueName: \"kubernetes.io/projected/9b5fdc5c-010a-45f6-9134-af288d22dd9f-kube-api-access-s2b9k\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:01:27.792337 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.792306    2580 generic.go:356] "Generic (PLEG): container finished" podID="9b5fdc5c-010a-45f6-9134-af288d22dd9f" containerID="21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369" exitCode=0
Jul 24 15:01:27.792495 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.792350    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"
Jul 24 15:01:27.792495 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.792403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz" event={"ID":"9b5fdc5c-010a-45f6-9134-af288d22dd9f","Type":"ContainerDied","Data":"21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369"}
Jul 24 15:01:27.792495 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.792458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz" event={"ID":"9b5fdc5c-010a-45f6-9134-af288d22dd9f","Type":"ContainerDied","Data":"01d7a2f7b52333624ac4ec90e583e2b2fd35db768a91b914c6f5933cf5c1868a"}
Jul 24 15:01:27.792495 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.792481    2580 scope.go:117] "RemoveContainer" containerID="21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369"
Jul 24 15:01:27.793851 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.793831    2580 generic.go:356] "Generic (PLEG): container finished" podID="6d791ca4-deb1-4a3d-b491-36c74834c6c8" containerID="125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7" exitCode=0
Jul 24 15:01:27.793980 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.793872    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"
Jul 24 15:01:27.793980 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.793878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp" event={"ID":"6d791ca4-deb1-4a3d-b491-36c74834c6c8","Type":"ContainerDied","Data":"125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7"}
Jul 24 15:01:27.793980 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.793919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp" event={"ID":"6d791ca4-deb1-4a3d-b491-36c74834c6c8","Type":"ContainerDied","Data":"28dda41632e2b013d82021d46272edd01ce2667051c9a86dbc6dea02a23835d4"}
Jul 24 15:01:27.801862 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.801844    2580 scope.go:117] "RemoveContainer" containerID="21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369"
Jul 24 15:01:27.802135 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:01:27.802117    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369\": container with ID starting with 21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369 not found: ID does not exist" containerID="21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369"
Jul 24 15:01:27.802204 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.802142    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369"} err="failed to get container status \"21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369\": rpc error: code = NotFound desc = could not find container \"21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369\": container with ID starting with 21ec1e12b7acc4e94a7a548218286c53a865b5d1e630b226ca6573b95eea7369 not found: ID does not exist"
Jul 24 15:01:27.802204 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.802158    2580 scope.go:117] "RemoveContainer" containerID="125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7"
Jul 24 15:01:27.810413 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.810399    2580 scope.go:117] "RemoveContainer" containerID="125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7"
Jul 24 15:01:27.810643 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:01:27.810622    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7\": container with ID starting with 125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7 not found: ID does not exist" containerID="125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7"
Jul 24 15:01:27.810705 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.810648    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7"} err="failed to get container status \"125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7\": rpc error: code = NotFound desc = could not find container \"125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7\": container with ID starting with 125807200aaba1fb60762e64e63abf9833f6ecc7133a88d6d09e64813af779e7 not found: ID does not exist"
Jul 24 15:01:27.819708 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.819685    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"]
Jul 24 15:01:27.828253 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.828235    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2feafa84-7f7ff64c8-f82dz"]
Jul 24 15:01:27.846298 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.846277    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"]
Jul 24 15:01:27.854838 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:27.854813    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2feafa84-7977867cff-qpjsp"]
Jul 24 15:01:29.065302 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:29.065260    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d791ca4-deb1-4a3d-b491-36c74834c6c8" path="/var/lib/kubelet/pods/6d791ca4-deb1-4a3d-b491-36c74834c6c8/volumes"
Jul 24 15:01:29.065821 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:01:29.065774    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5fdc5c-010a-45f6-9134-af288d22dd9f" path="/var/lib/kubelet/pods/9b5fdc5c-010a-45f6-9134-af288d22dd9f/volumes"
Jul 24 15:03:22.234440 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.234408    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"]
Jul 24 15:03:22.235062 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.234931    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5fdc5c-010a-45f6-9134-af288d22dd9f" containerName="payload-processing"
Jul 24 15:03:22.235062 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.234950    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5fdc5c-010a-45f6-9134-af288d22dd9f" containerName="payload-processing"
Jul 24 15:03:22.235062 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.234979    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d791ca4-deb1-4a3d-b491-36c74834c6c8" containerName="maas-api"
Jul 24 15:03:22.235062 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.234988    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d791ca4-deb1-4a3d-b491-36c74834c6c8" containerName="maas-api"
Jul 24 15:03:22.235275 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.235081    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d791ca4-deb1-4a3d-b491-36c74834c6c8" containerName="maas-api"
Jul 24 15:03:22.235275 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.235093    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5fdc5c-010a-45f6-9134-af288d22dd9f" containerName="payload-processing"
Jul 24 15:03:22.238099 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.238079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.254381 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.254359    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6726d865-serving-cert\""
Jul 24 15:03:22.275357 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.275324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"]
Jul 24 15:03:22.318014 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.317982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05e60aa-0fcf-49c6-b012-856d11374702-openshift-service-ca\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.318183 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.318046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.318183 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.318068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnsbc\" (UniqueName: \"kubernetes.io/projected/d05e60aa-0fcf-49c6-b012-856d11374702-kube-api-access-dnsbc\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.419193 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.419154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.419193 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.419194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnsbc\" (UniqueName: \"kubernetes.io/projected/d05e60aa-0fcf-49c6-b012-856d11374702-kube-api-access-dnsbc\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.419467 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.419246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05e60aa-0fcf-49c6-b012-856d11374702-openshift-service-ca\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.419467 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:03:22.419330    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-serving-cert: secret "maas-api-e2e-mt-6726d865-serving-cert" not found
Jul 24 15:03:22.419467 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:03:22.419405    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls podName:d05e60aa-0fcf-49c6-b012-856d11374702 nodeName:}" failed. No retries permitted until 2026-07-24 15:03:22.919382778 +0000 UTC m=+1880.271227959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls") pod "maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" (UID: "d05e60aa-0fcf-49c6-b012-856d11374702") : secret "maas-api-e2e-mt-6726d865-serving-cert" not found
Jul 24 15:03:22.419840 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.419822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05e60aa-0fcf-49c6-b012-856d11374702-openshift-service-ca\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.447831 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.447777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnsbc\" (UniqueName: \"kubernetes.io/projected/d05e60aa-0fcf-49c6-b012-856d11374702-kube-api-access-dnsbc\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.923610 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.923574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:22.926078 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:22.926058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls\") pod \"maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:23.147429 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:23.147395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:23.365596 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:23.365564    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"]
Jul 24 15:03:23.367908 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:03:23.367879    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05e60aa_0fcf_49c6_b012_856d11374702.slice/crio-a286b58fcf2c2c55bee82952513c605b8bf3b5cfce2b1a74738ab11917f87a14 WatchSource:0}: Error finding container a286b58fcf2c2c55bee82952513c605b8bf3b5cfce2b1a74738ab11917f87a14: Status 404 returned error can't find the container with id a286b58fcf2c2c55bee82952513c605b8bf3b5cfce2b1a74738ab11917f87a14
Jul 24 15:03:24.374015 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:24.373975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" event={"ID":"d05e60aa-0fcf-49c6-b012-856d11374702","Type":"ContainerStarted","Data":"3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95"}
Jul 24 15:03:24.374510 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:24.374049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" event={"ID":"d05e60aa-0fcf-49c6-b012-856d11374702","Type":"ContainerStarted","Data":"a286b58fcf2c2c55bee82952513c605b8bf3b5cfce2b1a74738ab11917f87a14"}
Jul 24 15:03:24.374510 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:24.374100    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:24.411743 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:24.411690    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" podStartSLOduration=1.611319736 podStartE2EDuration="2.411674131s" totalImagesPullingTime="800.354395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:24.409056534 +0000 UTC m=+1881.760901719" watchObservedRunningTime="2026-07-24 15:03:24.411674131 +0000 UTC m=+1881.763519316"
Jul 24 15:03:30.384671 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:30.384637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:44.931769 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:44.931735    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"]
Jul 24 15:03:44.932229 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:44.932011    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" podUID="d05e60aa-0fcf-49c6-b012-856d11374702" containerName="maas-api" containerID="cri-o://3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95" gracePeriod=30
Jul 24 15:03:45.181699 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.181673    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:45.230459 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.230351    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05e60aa-0fcf-49c6-b012-856d11374702-openshift-service-ca\") pod \"d05e60aa-0fcf-49c6-b012-856d11374702\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") "
Jul 24 15:03:45.230459 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.230406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnsbc\" (UniqueName: \"kubernetes.io/projected/d05e60aa-0fcf-49c6-b012-856d11374702-kube-api-access-dnsbc\") pod \"d05e60aa-0fcf-49c6-b012-856d11374702\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") "
Jul 24 15:03:45.230719 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.230485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls\") pod \"d05e60aa-0fcf-49c6-b012-856d11374702\" (UID: \"d05e60aa-0fcf-49c6-b012-856d11374702\") "
Jul 24 15:03:45.230836 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.230781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05e60aa-0fcf-49c6-b012-856d11374702-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d05e60aa-0fcf-49c6-b012-856d11374702" (UID: "d05e60aa-0fcf-49c6-b012-856d11374702"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:03:45.232721 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.232693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05e60aa-0fcf-49c6-b012-856d11374702-kube-api-access-dnsbc" (OuterVolumeSpecName: "kube-api-access-dnsbc") pod "d05e60aa-0fcf-49c6-b012-856d11374702" (UID: "d05e60aa-0fcf-49c6-b012-856d11374702"). InnerVolumeSpecName "kube-api-access-dnsbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:03:45.232843 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.232738    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d05e60aa-0fcf-49c6-b012-856d11374702" (UID: "d05e60aa-0fcf-49c6-b012-856d11374702"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:03:45.331396 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.331360    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05e60aa-0fcf-49c6-b012-856d11374702-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:03:45.331396 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.331389    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnsbc\" (UniqueName: \"kubernetes.io/projected/d05e60aa-0fcf-49c6-b012-856d11374702-kube-api-access-dnsbc\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:03:45.331396 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.331400    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05e60aa-0fcf-49c6-b012-856d11374702-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:03:45.479528 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.479493    2580 generic.go:356] "Generic (PLEG): container finished" podID="d05e60aa-0fcf-49c6-b012-856d11374702" containerID="3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95" exitCode=0
Jul 24 15:03:45.479528 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.479532    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"
Jul 24 15:03:45.479801 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.479576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" event={"ID":"d05e60aa-0fcf-49c6-b012-856d11374702","Type":"ContainerDied","Data":"3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95"}
Jul 24 15:03:45.479801 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.479638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf" event={"ID":"d05e60aa-0fcf-49c6-b012-856d11374702","Type":"ContainerDied","Data":"a286b58fcf2c2c55bee82952513c605b8bf3b5cfce2b1a74738ab11917f87a14"}
Jul 24 15:03:45.479801 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.479667    2580 scope.go:117] "RemoveContainer" containerID="3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95"
Jul 24 15:03:45.488712 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.488695    2580 scope.go:117] "RemoveContainer" containerID="3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95"
Jul 24 15:03:45.488986 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:03:45.488969    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95\": container with ID starting with 3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95 not found: ID does not exist" containerID="3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95"
Jul 24 15:03:45.489044 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.488993    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95"} err="failed to get container status \"3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95\": rpc error: code = NotFound desc = could not find container \"3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95\": container with ID starting with 3dfcdd351e9bcd8daf176d260e91c72a36afe5d3a86ce2e37a3732636b520e95 not found: ID does not exist"
Jul 24 15:03:45.503047 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.503025    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"]
Jul 24 15:03:45.507545 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:45.507525    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6726d865-6d4bdbfdbd-9n9pf"]
Jul 24 15:03:47.065993 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:03:47.065961    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d05e60aa-0fcf-49c6-b012-856d11374702" path="/var/lib/kubelet/pods/d05e60aa-0fcf-49c6-b012-856d11374702/volumes"
Jul 24 15:04:20.351100 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.351067    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"]
Jul 24 15:04:20.351553 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.351389    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05e60aa-0fcf-49c6-b012-856d11374702" containerName="maas-api"
Jul 24 15:04:20.351553 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.351400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05e60aa-0fcf-49c6-b012-856d11374702" containerName="maas-api"
Jul 24 15:04:20.351553 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.351472    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d05e60aa-0fcf-49c6-b012-856d11374702" containerName="maas-api"
Jul 24 15:04:20.354841 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.354821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.358645 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.358621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-040dfbba-serving-cert\""
Jul 24 15:04:20.369114 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.369088    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"]
Jul 24 15:04:20.551712 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.551673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a81e0e-793a-45c0-8850-0f1f9303bfb7-maas-api-tls\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.551712 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.551735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a81e0e-793a-45c0-8850-0f1f9303bfb7-openshift-service-ca\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.551998 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.551781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmmq\" (UniqueName: \"kubernetes.io/projected/86a81e0e-793a-45c0-8850-0f1f9303bfb7-kube-api-access-lrmmq\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.652602 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.652514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a81e0e-793a-45c0-8850-0f1f9303bfb7-maas-api-tls\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.652602 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.652576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a81e0e-793a-45c0-8850-0f1f9303bfb7-openshift-service-ca\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.652826 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.652608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmmq\" (UniqueName: \"kubernetes.io/projected/86a81e0e-793a-45c0-8850-0f1f9303bfb7-kube-api-access-lrmmq\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.653331 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.653307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a81e0e-793a-45c0-8850-0f1f9303bfb7-openshift-service-ca\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.655113 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.655095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a81e0e-793a-45c0-8850-0f1f9303bfb7-maas-api-tls\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.662198 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.662174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmmq\" (UniqueName: \"kubernetes.io/projected/86a81e0e-793a-45c0-8850-0f1f9303bfb7-kube-api-access-lrmmq\") pod \"maas-api-e2e-mt-040dfbba-bfd858759-w8jqn\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.664990 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.664968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:20.802422 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.802343    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"]
Jul 24 15:04:20.806383 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:20.806362    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:04:21.666647 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:21.666613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn" event={"ID":"86a81e0e-793a-45c0-8850-0f1f9303bfb7","Type":"ContainerStarted","Data":"9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290"}
Jul 24 15:04:21.667049 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:21.666672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:04:21.667049 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:21.666689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn" event={"ID":"86a81e0e-793a-45c0-8850-0f1f9303bfb7","Type":"ContainerStarted","Data":"97338adb1ee6f5b56f9dacd4604b58e7ed2cf811d1fe4f6e60804cd326da2322"}
Jul 24 15:04:21.689179 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:21.689129    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn" podStartSLOduration=1.13853177 podStartE2EDuration="1.689113751s" totalImagesPullingTime="550.581981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:21.685746105 +0000 UTC m=+1939.037591291" watchObservedRunningTime="2026-07-24 15:04:21.689113751 +0000 UTC m=+1939.040958935"
Jul 24 15:04:27.676739 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:04:27.676707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:05:25.111906 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.111832    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"]
Jul 24 15:05:25.112388 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.112053    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn" podUID="86a81e0e-793a-45c0-8850-0f1f9303bfb7" containerName="maas-api" containerID="cri-o://9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290" gracePeriod=30
Jul 24 15:05:25.363482 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.363412    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:05:25.423385 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.423357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrmmq\" (UniqueName: \"kubernetes.io/projected/86a81e0e-793a-45c0-8850-0f1f9303bfb7-kube-api-access-lrmmq\") pod \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") "
Jul 24 15:05:25.423585 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.423399    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a81e0e-793a-45c0-8850-0f1f9303bfb7-maas-api-tls\") pod \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") "
Jul 24 15:05:25.423585 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.423469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a81e0e-793a-45c0-8850-0f1f9303bfb7-openshift-service-ca\") pod \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\" (UID: \"86a81e0e-793a-45c0-8850-0f1f9303bfb7\") "
Jul 24 15:05:25.423922 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.423888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a81e0e-793a-45c0-8850-0f1f9303bfb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86a81e0e-793a-45c0-8850-0f1f9303bfb7" (UID: "86a81e0e-793a-45c0-8850-0f1f9303bfb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:05:25.425408 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.425383    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a81e0e-793a-45c0-8850-0f1f9303bfb7-kube-api-access-lrmmq" (OuterVolumeSpecName: "kube-api-access-lrmmq") pod "86a81e0e-793a-45c0-8850-0f1f9303bfb7" (UID: "86a81e0e-793a-45c0-8850-0f1f9303bfb7"). InnerVolumeSpecName "kube-api-access-lrmmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:05:25.425530 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.425461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a81e0e-793a-45c0-8850-0f1f9303bfb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86a81e0e-793a-45c0-8850-0f1f9303bfb7" (UID: "86a81e0e-793a-45c0-8850-0f1f9303bfb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:05:25.524591 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.524557    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrmmq\" (UniqueName: \"kubernetes.io/projected/86a81e0e-793a-45c0-8850-0f1f9303bfb7-kube-api-access-lrmmq\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:05:25.524591 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.524586    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a81e0e-793a-45c0-8850-0f1f9303bfb7-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:05:25.524591 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.524598    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a81e0e-793a-45c0-8850-0f1f9303bfb7-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:05:25.995195 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.995161    2580 generic.go:356] "Generic (PLEG): container finished" podID="86a81e0e-793a-45c0-8850-0f1f9303bfb7" containerID="9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290" exitCode=0
Jul 24 15:05:25.995384 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.995218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn" event={"ID":"86a81e0e-793a-45c0-8850-0f1f9303bfb7","Type":"ContainerDied","Data":"9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290"}
Jul 24 15:05:25.995384 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.995235    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"
Jul 24 15:05:25.995384 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.995265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn" event={"ID":"86a81e0e-793a-45c0-8850-0f1f9303bfb7","Type":"ContainerDied","Data":"97338adb1ee6f5b56f9dacd4604b58e7ed2cf811d1fe4f6e60804cd326da2322"}
Jul 24 15:05:25.995384 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:25.995286    2580 scope.go:117] "RemoveContainer" containerID="9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290"
Jul 24 15:05:26.005038 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:26.005020    2580 scope.go:117] "RemoveContainer" containerID="9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290"
Jul 24 15:05:26.005317 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:05:26.005294    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290\": container with ID starting with 9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290 not found: ID does not exist" containerID="9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290"
Jul 24 15:05:26.005362 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:26.005329    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290"} err="failed to get container status \"9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290\": rpc error: code = NotFound desc = could not find container \"9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290\": container with ID starting with 9be409e5584d72f996c2be106f53adeb9b11ab3d8a9092c4986dc969b33e6290 not found: ID does not exist"
Jul 24 15:05:26.018975 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:26.018942    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"]
Jul 24 15:05:26.023112 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:26.023087    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-040dfbba-bfd858759-w8jqn"]
Jul 24 15:05:27.065243 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:05:27.065207    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a81e0e-793a-45c0-8850-0f1f9303bfb7" path="/var/lib/kubelet/pods/86a81e0e-793a-45c0-8850-0f1f9303bfb7/volumes"
Jul 24 15:07:22.413896 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.413864    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"]
Jul 24 15:07:22.414377 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.414237    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a81e0e-793a-45c0-8850-0f1f9303bfb7" containerName="maas-api"
Jul 24 15:07:22.414377 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.414250    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a81e0e-793a-45c0-8850-0f1f9303bfb7" containerName="maas-api"
Jul 24 15:07:22.414377 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.414316    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a81e0e-793a-45c0-8850-0f1f9303bfb7" containerName="maas-api"
Jul 24 15:07:22.416803 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.416768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.419651 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.419634    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-39743c-serving-cert\""
Jul 24 15:07:22.431455 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.431429    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"]
Jul 24 15:07:22.553444 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.553403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.553444 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.553444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a2969c-1048-4818-9f40-efeb7792ff73-openshift-service-ca\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.553715 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.553610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl5bg\" (UniqueName: \"kubernetes.io/projected/99a2969c-1048-4818-9f40-efeb7792ff73-kube-api-access-dl5bg\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.655015 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.654980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.655015 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.655014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a2969c-1048-4818-9f40-efeb7792ff73-openshift-service-ca\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.655273 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.655093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl5bg\" (UniqueName: \"kubernetes.io/projected/99a2969c-1048-4818-9f40-efeb7792ff73-kube-api-access-dl5bg\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.655273 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:07:22.655126    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-serving-cert: secret "maas-api-e2e-inf-a-39743c-serving-cert" not found
Jul 24 15:07:22.655273 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:07:22.655191    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls podName:99a2969c-1048-4818-9f40-efeb7792ff73 nodeName:}" failed. No retries permitted until 2026-07-24 15:07:23.155176446 +0000 UTC m=+2120.507021609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls") pod "maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" (UID: "99a2969c-1048-4818-9f40-efeb7792ff73") : secret "maas-api-e2e-inf-a-39743c-serving-cert" not found
Jul 24 15:07:22.655750 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.655720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a2969c-1048-4818-9f40-efeb7792ff73-openshift-service-ca\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:22.678555 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:22.678482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl5bg\" (UniqueName: \"kubernetes.io/projected/99a2969c-1048-4818-9f40-efeb7792ff73-kube-api-access-dl5bg\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:23.159584 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:23.159557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:23.162235 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:23.162103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls\") pod \"maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:23.326771 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:23.326735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:23.470683 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:23.470659    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"]
Jul 24 15:07:23.472566 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:07:23.472540    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a2969c_1048_4818_9f40_efeb7792ff73.slice/crio-661b6e9b5ba9106523ae13e4a3a6b3350531c19b13e9f63cf68c7a474bd14d01 WatchSource:0}: Error finding container 661b6e9b5ba9106523ae13e4a3a6b3350531c19b13e9f63cf68c7a474bd14d01: Status 404 returned error can't find the container with id 661b6e9b5ba9106523ae13e4a3a6b3350531c19b13e9f63cf68c7a474bd14d01
Jul 24 15:07:23.599987 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:23.599950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" event={"ID":"99a2969c-1048-4818-9f40-efeb7792ff73","Type":"ContainerStarted","Data":"661b6e9b5ba9106523ae13e4a3a6b3350531c19b13e9f63cf68c7a474bd14d01"}
Jul 24 15:07:24.606735 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:24.606701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" event={"ID":"99a2969c-1048-4818-9f40-efeb7792ff73","Type":"ContainerStarted","Data":"9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2"}
Jul 24 15:07:24.607156 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:24.606828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:24.627095 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:24.627046    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" podStartSLOduration=2.045534411 podStartE2EDuration="2.627029689s" totalImagesPullingTime="581.495278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:24.625413931 +0000 UTC m=+2121.977259128" watchObservedRunningTime="2026-07-24 15:07:24.627029689 +0000 UTC m=+2121.978874928"
Jul 24 15:07:30.322460 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.322424    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"]
Jul 24 15:07:30.326397 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.326375    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.329637 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.329615    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-97e60f-serving-cert\""
Jul 24 15:07:30.341825 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.341783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"]
Jul 24 15:07:30.425237 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.425198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.425427 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.425248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm7nm\" (UniqueName: \"kubernetes.io/projected/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-kube-api-access-sm7nm\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.425427 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.425384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.526039 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.526001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm7nm\" (UniqueName: \"kubernetes.io/projected/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-kube-api-access-sm7nm\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.526214 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.526063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.526214 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.526118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.526752 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.526731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.528525 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.528501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.542179 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.542146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm7nm\" (UniqueName: \"kubernetes.io/projected/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-kube-api-access-sm7nm\") pod \"maas-api-e2e-inf-b-97e60f-8686765488-j2dfs\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.617385 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.617310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:07:30.637531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.637499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:30.775584 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:30.775556    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"]
Jul 24 15:07:30.777326 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:07:30.777294    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8ea509_6b17_4d61_9ec6_4b9846793d6a.slice/crio-6dfce3cc572614bf6a526de1580a5948ac57c74d90b4f8d7a7874d7f2d20acfb WatchSource:0}: Error finding container 6dfce3cc572614bf6a526de1580a5948ac57c74d90b4f8d7a7874d7f2d20acfb: Status 404 returned error can't find the container with id 6dfce3cc572614bf6a526de1580a5948ac57c74d90b4f8d7a7874d7f2d20acfb
Jul 24 15:07:31.084396 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.084363    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"]
Jul 24 15:07:31.087548 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.087530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.090651 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.090628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-97e60f-dockercfg-2jzwm\""
Jul 24 15:07:31.090772 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.090676    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-97e60f\""
Jul 24 15:07:31.099963 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.099941    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"]
Jul 24 15:07:31.125902 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.124597    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"]
Jul 24 15:07:31.128630 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.128614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.138973 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.138945    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"]
Jul 24 15:07:31.232819 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.232762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kj9s\" (UniqueName: \"kubernetes.io/projected/2250212d-c271-4e12-ac13-6c8b0a65e17b-kube-api-access-2kj9s\") pod \"payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.232995 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.232857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqwv2\" (UniqueName: \"kubernetes.io/projected/09686dd2-e247-47d7-a0ea-0630f294efc6-kube-api-access-gqwv2\") pod \"payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.232995 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.232890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2250212d-c271-4e12-ac13-6c8b0a65e17b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.232995 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.232941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09686dd2-e247-47d7-a0ea-0630f294efc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.333752 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.333715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kj9s\" (UniqueName: \"kubernetes.io/projected/2250212d-c271-4e12-ac13-6c8b0a65e17b-kube-api-access-2kj9s\") pod \"payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.334195 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.333771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqwv2\" (UniqueName: \"kubernetes.io/projected/09686dd2-e247-47d7-a0ea-0630f294efc6-kube-api-access-gqwv2\") pod \"payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.334195 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.333815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2250212d-c271-4e12-ac13-6c8b0a65e17b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.334195 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.333838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09686dd2-e247-47d7-a0ea-0630f294efc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.334785 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.334734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09686dd2-e247-47d7-a0ea-0630f294efc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.334785 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.334734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2250212d-c271-4e12-ac13-6c8b0a65e17b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.342314 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.342286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqwv2\" (UniqueName: \"kubernetes.io/projected/09686dd2-e247-47d7-a0ea-0630f294efc6-kube-api-access-gqwv2\") pod \"payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.342490 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.342291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kj9s\" (UniqueName: \"kubernetes.io/projected/2250212d-c271-4e12-ac13-6c8b0a65e17b-kube-api-access-2kj9s\") pod \"payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.399379 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.399342    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.453820 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.453773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:31.548508 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.548476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"]
Jul 24 15:07:31.549998 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:07:31.549969    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2250212d_c271_4e12_ac13_6c8b0a65e17b.slice/crio-e7c0427755f22e3f5e1551601be8d204e1bd32c82763e1f9dc6d117f75240608 WatchSource:0}: Error finding container e7c0427755f22e3f5e1551601be8d204e1bd32c82763e1f9dc6d117f75240608: Status 404 returned error can't find the container with id e7c0427755f22e3f5e1551601be8d204e1bd32c82763e1f9dc6d117f75240608
Jul 24 15:07:31.614033 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:07:31.613999    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09686dd2_e247_47d7_a0ea_0630f294efc6.slice/crio-b1ee06a7436b3a77c879f0b36d55ae1867c1fc1e71bb104023dbf7e8b2bd713b WatchSource:0}: Error finding container b1ee06a7436b3a77c879f0b36d55ae1867c1fc1e71bb104023dbf7e8b2bd713b: Status 404 returned error can't find the container with id b1ee06a7436b3a77c879f0b36d55ae1867c1fc1e71bb104023dbf7e8b2bd713b
Jul 24 15:07:31.614408 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.614388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"]
Jul 24 15:07:31.643371 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.643338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s" event={"ID":"09686dd2-e247-47d7-a0ea-0630f294efc6","Type":"ContainerStarted","Data":"b1ee06a7436b3a77c879f0b36d55ae1867c1fc1e71bb104023dbf7e8b2bd713b"}
Jul 24 15:07:31.644911 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.644885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq" event={"ID":"2250212d-c271-4e12-ac13-6c8b0a65e17b","Type":"ContainerStarted","Data":"135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7"}
Jul 24 15:07:31.645043 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.644933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq" event={"ID":"2250212d-c271-4e12-ac13-6c8b0a65e17b","Type":"ContainerStarted","Data":"e7c0427755f22e3f5e1551601be8d204e1bd32c82763e1f9dc6d117f75240608"}
Jul 24 15:07:31.645106 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.645052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:31.646578 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.646554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs" event={"ID":"4d8ea509-6b17-4d61-9ec6-4b9846793d6a","Type":"ContainerStarted","Data":"d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43"}
Jul 24 15:07:31.646701 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.646602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs" event={"ID":"4d8ea509-6b17-4d61-9ec6-4b9846793d6a","Type":"ContainerStarted","Data":"6dfce3cc572614bf6a526de1580a5948ac57c74d90b4f8d7a7874d7f2d20acfb"}
Jul 24 15:07:31.646701 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.646630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:31.663929 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.663881    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq" podStartSLOduration=0.663864058 podStartE2EDuration="663.864058ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:31.661707994 +0000 UTC m=+2129.013553210" watchObservedRunningTime="2026-07-24 15:07:31.663864058 +0000 UTC m=+2129.015709243"
Jul 24 15:07:31.684446 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:31.684395    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs" podStartSLOduration=1.351465781 podStartE2EDuration="1.68437617s" totalImagesPullingTime="332.910389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:31.680774604 +0000 UTC m=+2129.032619793" watchObservedRunningTime="2026-07-24 15:07:31.68437617 +0000 UTC m=+2129.036221357"
Jul 24 15:07:32.654352 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:32.654318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s" event={"ID":"09686dd2-e247-47d7-a0ea-0630f294efc6","Type":"ContainerStarted","Data":"dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5"}
Jul 24 15:07:32.654864 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:32.654402    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:07:32.676072 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:32.676022    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s" podStartSLOduration=1.676005261 podStartE2EDuration="1.676005261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:32.67421979 +0000 UTC m=+2130.026064989" watchObservedRunningTime="2026-07-24 15:07:32.676005261 +0000 UTC m=+2130.027850445"
Jul 24 15:07:37.660773 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:37.660744    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:07:42.656747 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:42.656718    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:07:43.661962 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:07:43.661934    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:09:16.619663 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.619618    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"]
Jul 24 15:09:16.620321 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.619895    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" podUID="99a2969c-1048-4818-9f40-efeb7792ff73" containerName="maas-api" containerID="cri-o://9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2" gracePeriod=30
Jul 24 15:09:16.879444 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.879384    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:09:16.979435 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.979399    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls\") pod \"99a2969c-1048-4818-9f40-efeb7792ff73\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") "
Jul 24 15:09:16.979607 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.979466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl5bg\" (UniqueName: \"kubernetes.io/projected/99a2969c-1048-4818-9f40-efeb7792ff73-kube-api-access-dl5bg\") pod \"99a2969c-1048-4818-9f40-efeb7792ff73\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") "
Jul 24 15:09:16.979607 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.979565    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a2969c-1048-4818-9f40-efeb7792ff73-openshift-service-ca\") pod \"99a2969c-1048-4818-9f40-efeb7792ff73\" (UID: \"99a2969c-1048-4818-9f40-efeb7792ff73\") "
Jul 24 15:09:16.979911 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.979881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a2969c-1048-4818-9f40-efeb7792ff73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99a2969c-1048-4818-9f40-efeb7792ff73" (UID: "99a2969c-1048-4818-9f40-efeb7792ff73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:09:16.981557 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.981529    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99a2969c-1048-4818-9f40-efeb7792ff73" (UID: "99a2969c-1048-4818-9f40-efeb7792ff73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:09:16.981640 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:16.981552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a2969c-1048-4818-9f40-efeb7792ff73-kube-api-access-dl5bg" (OuterVolumeSpecName: "kube-api-access-dl5bg") pod "99a2969c-1048-4818-9f40-efeb7792ff73" (UID: "99a2969c-1048-4818-9f40-efeb7792ff73"). InnerVolumeSpecName "kube-api-access-dl5bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:09:17.081074 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.081049    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a2969c-1048-4818-9f40-efeb7792ff73-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:17.081074 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.081074    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a2969c-1048-4818-9f40-efeb7792ff73-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:17.081262 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.081083    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl5bg\" (UniqueName: \"kubernetes.io/projected/99a2969c-1048-4818-9f40-efeb7792ff73-kube-api-access-dl5bg\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:17.219022 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.218986    2580 generic.go:356] "Generic (PLEG): container finished" podID="99a2969c-1048-4818-9f40-efeb7792ff73" containerID="9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2" exitCode=0
Jul 24 15:09:17.219202 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.219039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" event={"ID":"99a2969c-1048-4818-9f40-efeb7792ff73","Type":"ContainerDied","Data":"9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2"}
Jul 24 15:09:17.219202 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.219051    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"
Jul 24 15:09:17.219202 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.219112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb" event={"ID":"99a2969c-1048-4818-9f40-efeb7792ff73","Type":"ContainerDied","Data":"661b6e9b5ba9106523ae13e4a3a6b3350531c19b13e9f63cf68c7a474bd14d01"}
Jul 24 15:09:17.219202 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.219136    2580 scope.go:117] "RemoveContainer" containerID="9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2"
Jul 24 15:09:17.227818 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.227774    2580 scope.go:117] "RemoveContainer" containerID="9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2"
Jul 24 15:09:17.228082 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:09:17.228061    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2\": container with ID starting with 9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2 not found: ID does not exist" containerID="9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2"
Jul 24 15:09:17.228138 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.228089    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2"} err="failed to get container status \"9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2\": rpc error: code = NotFound desc = could not find container \"9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2\": container with ID starting with 9347872172a5a91e94d36c46c63f850642ff6e6861528760d8e73f8454dc11f2 not found: ID does not exist"
Jul 24 15:09:17.282941 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.282907    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"]
Jul 24 15:09:17.285008 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:17.284989    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-39743c-6d4877b967-rbcbb"]
Jul 24 15:09:19.065621 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:19.065582    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a2969c-1048-4818-9f40-efeb7792ff73" path="/var/lib/kubelet/pods/99a2969c-1048-4818-9f40-efeb7792ff73/volumes"
Jul 24 15:09:38.904520 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:38.904482    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"]
Jul 24 15:09:38.905122 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:38.904819    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs" podUID="4d8ea509-6b17-4d61-9ec6-4b9846793d6a" containerName="maas-api" containerID="cri-o://d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43" gracePeriod=30
Jul 24 15:09:38.966460 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:38.966427    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"]
Jul 24 15:09:38.966744 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:38.966709    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq" podUID="2250212d-c271-4e12-ac13-6c8b0a65e17b" containerName="payload-processing" containerID="cri-o://135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7" gracePeriod=30
Jul 24 15:09:38.981927 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:38.981898    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"]
Jul 24 15:09:38.983705 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:38.982527    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s" podUID="09686dd2-e247-47d7-a0ea-0630f294efc6" containerName="payload-pre-processing" containerID="cri-o://dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5" gracePeriod=30
Jul 24 15:09:39.265948 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.265923    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:09:39.268853 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.268832    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:09:39.282403 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.282374    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:09:39.337145 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.337111    2580 generic.go:356] "Generic (PLEG): container finished" podID="2250212d-c271-4e12-ac13-6c8b0a65e17b" containerID="135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7" exitCode=0
Jul 24 15:09:39.337311 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.337158    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"
Jul 24 15:09:39.337311 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.337194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq" event={"ID":"2250212d-c271-4e12-ac13-6c8b0a65e17b","Type":"ContainerDied","Data":"135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7"}
Jul 24 15:09:39.337311 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.337249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq" event={"ID":"2250212d-c271-4e12-ac13-6c8b0a65e17b","Type":"ContainerDied","Data":"e7c0427755f22e3f5e1551601be8d204e1bd32c82763e1f9dc6d117f75240608"}
Jul 24 15:09:39.337311 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.337279    2580 scope.go:117] "RemoveContainer" containerID="135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7"
Jul 24 15:09:39.338668 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.338631    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d8ea509-6b17-4d61-9ec6-4b9846793d6a" containerID="d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43" exitCode=0
Jul 24 15:09:39.338819 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.338676    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"
Jul 24 15:09:39.338819 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.338689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs" event={"ID":"4d8ea509-6b17-4d61-9ec6-4b9846793d6a","Type":"ContainerDied","Data":"d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43"}
Jul 24 15:09:39.338819 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.338730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs" event={"ID":"4d8ea509-6b17-4d61-9ec6-4b9846793d6a","Type":"ContainerDied","Data":"6dfce3cc572614bf6a526de1580a5948ac57c74d90b4f8d7a7874d7f2d20acfb"}
Jul 24 15:09:39.340286 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.340261    2580 generic.go:356] "Generic (PLEG): container finished" podID="09686dd2-e247-47d7-a0ea-0630f294efc6" containerID="dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5" exitCode=0
Jul 24 15:09:39.340401 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.340294    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"
Jul 24 15:09:39.340401 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.340324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s" event={"ID":"09686dd2-e247-47d7-a0ea-0630f294efc6","Type":"ContainerDied","Data":"dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5"}
Jul 24 15:09:39.340401 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.340360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s" event={"ID":"09686dd2-e247-47d7-a0ea-0630f294efc6","Type":"ContainerDied","Data":"b1ee06a7436b3a77c879f0b36d55ae1867c1fc1e71bb104023dbf7e8b2bd713b"}
Jul 24 15:09:39.346482 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.346464    2580 scope.go:117] "RemoveContainer" containerID="135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7"
Jul 24 15:09:39.346928 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:09:39.346775    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7\": container with ID starting with 135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7 not found: ID does not exist" containerID="135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7"
Jul 24 15:09:39.347053 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.346945    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7"} err="failed to get container status \"135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7\": rpc error: code = NotFound desc = could not find container \"135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7\": container with ID starting with 135a6b636d1d83cfbe7273d8082a77947f5eed05ae1e6abeeca7248de7bfddc7 not found: ID does not exist"
Jul 24 15:09:39.347053 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.346969    2580 scope.go:117] "RemoveContainer" containerID="d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43"
Jul 24 15:09:39.354877 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.354859    2580 scope.go:117] "RemoveContainer" containerID="d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43"
Jul 24 15:09:39.355134 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:09:39.355117    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43\": container with ID starting with d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43 not found: ID does not exist" containerID="d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43"
Jul 24 15:09:39.355183 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.355147    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43"} err="failed to get container status \"d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43\": rpc error: code = NotFound desc = could not find container \"d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43\": container with ID starting with d2403aba93c0d8cebd3c95b4fc3ca62690e41d80acd8836630a1bd7f67097d43 not found: ID does not exist"
Jul 24 15:09:39.355183 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.355163    2580 scope.go:117] "RemoveContainer" containerID="dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5"
Jul 24 15:09:39.362890 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.362871    2580 scope.go:117] "RemoveContainer" containerID="dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5"
Jul 24 15:09:39.363160 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:09:39.363143    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5\": container with ID starting with dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5 not found: ID does not exist" containerID="dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5"
Jul 24 15:09:39.363219 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.363170    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5"} err="failed to get container status \"dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5\": rpc error: code = NotFound desc = could not find container \"dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5\": container with ID starting with dce043650e8c2deeb6b4cd19de825c7c57a8b83525cf076ce7ec0ac994d632f5 not found: ID does not exist"
Jul 24 15:09:39.368390 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368370    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2250212d-c271-4e12-ac13-6c8b0a65e17b-plugins-config-volume\") pod \"2250212d-c271-4e12-ac13-6c8b0a65e17b\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") "
Jul 24 15:09:39.368462 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kj9s\" (UniqueName: \"kubernetes.io/projected/2250212d-c271-4e12-ac13-6c8b0a65e17b-kube-api-access-2kj9s\") pod \"2250212d-c271-4e12-ac13-6c8b0a65e17b\" (UID: \"2250212d-c271-4e12-ac13-6c8b0a65e17b\") "
Jul 24 15:09:39.368462 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368447    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-openshift-service-ca\") pod \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") "
Jul 24 15:09:39.368575 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368470    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqwv2\" (UniqueName: \"kubernetes.io/projected/09686dd2-e247-47d7-a0ea-0630f294efc6-kube-api-access-gqwv2\") pod \"09686dd2-e247-47d7-a0ea-0630f294efc6\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") "
Jul 24 15:09:39.368575 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-maas-api-tls\") pod \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") "
Jul 24 15:09:39.368575 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368563    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm7nm\" (UniqueName: \"kubernetes.io/projected/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-kube-api-access-sm7nm\") pod \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\" (UID: \"4d8ea509-6b17-4d61-9ec6-4b9846793d6a\") "
Jul 24 15:09:39.368733 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368668    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09686dd2-e247-47d7-a0ea-0630f294efc6-plugins-config-volume\") pod \"09686dd2-e247-47d7-a0ea-0630f294efc6\" (UID: \"09686dd2-e247-47d7-a0ea-0630f294efc6\") "
Jul 24 15:09:39.368922 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368815    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2250212d-c271-4e12-ac13-6c8b0a65e17b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2250212d-c271-4e12-ac13-6c8b0a65e17b" (UID: "2250212d-c271-4e12-ac13-6c8b0a65e17b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:09:39.368922 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.368846    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d8ea509-6b17-4d61-9ec6-4b9846793d6a" (UID: "4d8ea509-6b17-4d61-9ec6-4b9846793d6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:09:39.369135 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.369088    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2250212d-c271-4e12-ac13-6c8b0a65e17b-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.369135 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.369111    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.369244 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.369152    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09686dd2-e247-47d7-a0ea-0630f294efc6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "09686dd2-e247-47d7-a0ea-0630f294efc6" (UID: "09686dd2-e247-47d7-a0ea-0630f294efc6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:09:39.370520 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.370500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2250212d-c271-4e12-ac13-6c8b0a65e17b-kube-api-access-2kj9s" (OuterVolumeSpecName: "kube-api-access-2kj9s") pod "2250212d-c271-4e12-ac13-6c8b0a65e17b" (UID: "2250212d-c271-4e12-ac13-6c8b0a65e17b"). InnerVolumeSpecName "kube-api-access-2kj9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:09:39.370683 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.370662    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d8ea509-6b17-4d61-9ec6-4b9846793d6a" (UID: "4d8ea509-6b17-4d61-9ec6-4b9846793d6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:09:39.370931 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.370913    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09686dd2-e247-47d7-a0ea-0630f294efc6-kube-api-access-gqwv2" (OuterVolumeSpecName: "kube-api-access-gqwv2") pod "09686dd2-e247-47d7-a0ea-0630f294efc6" (UID: "09686dd2-e247-47d7-a0ea-0630f294efc6"). InnerVolumeSpecName "kube-api-access-gqwv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:09:39.371038 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.371018    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-kube-api-access-sm7nm" (OuterVolumeSpecName: "kube-api-access-sm7nm") pod "4d8ea509-6b17-4d61-9ec6-4b9846793d6a" (UID: "4d8ea509-6b17-4d61-9ec6-4b9846793d6a"). InnerVolumeSpecName "kube-api-access-sm7nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:09:39.470437 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.470354    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqwv2\" (UniqueName: \"kubernetes.io/projected/09686dd2-e247-47d7-a0ea-0630f294efc6-kube-api-access-gqwv2\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.470437 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.470386    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.470437 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.470398    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm7nm\" (UniqueName: \"kubernetes.io/projected/4d8ea509-6b17-4d61-9ec6-4b9846793d6a-kube-api-access-sm7nm\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.470437 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.470413    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09686dd2-e247-47d7-a0ea-0630f294efc6-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.470437 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.470426    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kj9s\" (UniqueName: \"kubernetes.io/projected/2250212d-c271-4e12-ac13-6c8b0a65e17b-kube-api-access-2kj9s\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:09:39.664463 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.664433    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"]
Jul 24 15:09:39.667922 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.667894    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-97e60f-bcbdb9bb6-5crdq"]
Jul 24 15:09:39.677947 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.677919    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"]
Jul 24 15:09:39.682081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.682060    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-97e60f-8686765488-j2dfs"]
Jul 24 15:09:39.692900 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.692873    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"]
Jul 24 15:09:39.696231 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:39.696211    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-97e60f-88f955b8d-4kw7s"]
Jul 24 15:09:41.064911 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:41.064877    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09686dd2-e247-47d7-a0ea-0630f294efc6" path="/var/lib/kubelet/pods/09686dd2-e247-47d7-a0ea-0630f294efc6/volumes"
Jul 24 15:09:41.065295 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:41.065245    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2250212d-c271-4e12-ac13-6c8b0a65e17b" path="/var/lib/kubelet/pods/2250212d-c271-4e12-ac13-6c8b0a65e17b/volumes"
Jul 24 15:09:41.065574 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:41.065561    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d8ea509-6b17-4d61-9ec6-4b9846793d6a" path="/var/lib/kubelet/pods/4d8ea509-6b17-4d61-9ec6-4b9846793d6a/volumes"
Jul 24 15:09:54.113555 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113518    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"]
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113921    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09686dd2-e247-47d7-a0ea-0630f294efc6" containerName="payload-pre-processing"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09686dd2-e247-47d7-a0ea-0630f294efc6" containerName="payload-pre-processing"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113946    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a2969c-1048-4818-9f40-efeb7792ff73" containerName="maas-api"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113952    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a2969c-1048-4818-9f40-efeb7792ff73" containerName="maas-api"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113960    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8ea509-6b17-4d61-9ec6-4b9846793d6a" containerName="maas-api"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113965    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8ea509-6b17-4d61-9ec6-4b9846793d6a" containerName="maas-api"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113979    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2250212d-c271-4e12-ac13-6c8b0a65e17b" containerName="payload-processing"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.113984    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2250212d-c271-4e12-ac13-6c8b0a65e17b" containerName="payload-processing"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.114051    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2250212d-c271-4e12-ac13-6c8b0a65e17b" containerName="payload-processing"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.114058    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8ea509-6b17-4d61-9ec6-4b9846793d6a" containerName="maas-api"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.114065    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="09686dd2-e247-47d7-a0ea-0630f294efc6" containerName="payload-pre-processing"
Jul 24 15:09:54.114081 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.114071    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a2969c-1048-4818-9f40-efeb7792ff73" containerName="maas-api"
Jul 24 15:09:54.117044 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.117026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.119430 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.119413    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b1e6f9-serving-cert\""
Jul 24 15:09:54.127701 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.127672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"]
Jul 24 15:09:54.195261 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.195227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-openshift-service-ca\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.195441 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.195296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7n4\" (UniqueName: \"kubernetes.io/projected/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-kube-api-access-fn7n4\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.195441 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.195364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.296464 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.296426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-openshift-service-ca\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.296630 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.296537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7n4\" (UniqueName: \"kubernetes.io/projected/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-kube-api-access-fn7n4\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.296685 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.296654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.296859 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:09:54.296829    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-serving-cert: secret "maas-api-e2e-api-a-b1e6f9-serving-cert" not found
Jul 24 15:09:54.296952 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:09:54.296934    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls podName:eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599 nodeName:}" failed. No retries permitted until 2026-07-24 15:09:54.796913038 +0000 UTC m=+2272.148758216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls") pod "maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" (UID: "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599") : secret "maas-api-e2e-api-a-b1e6f9-serving-cert" not found
Jul 24 15:09:54.297046 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.297028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-openshift-service-ca\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.305474 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.305452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7n4\" (UniqueName: \"kubernetes.io/projected/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-kube-api-access-fn7n4\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.801248 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.801203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:54.803845 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:54.803816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls\") pod \"maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:55.027163 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.027096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:55.057853 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.057765    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"]
Jul 24 15:09:55.061292 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.061269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.063689 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.063663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b1e6f9\""
Jul 24 15:09:55.063991 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.063973    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b1e6f9-dockercfg-tqpsf\""
Jul 24 15:09:55.073533 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.073499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"]
Jul 24 15:09:55.181735 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.181675    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"]
Jul 24 15:09:55.182071 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:09:55.181707    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb50a57_3f2b_4c86_b1bb_2ecba7f2b599.slice/crio-dc718d4bc4b30b9ce5370c3cdab936f8dc4f0926a70021f1b1b10f56b6fd55a9 WatchSource:0}: Error finding container dc718d4bc4b30b9ce5370c3cdab936f8dc4f0926a70021f1b1b10f56b6fd55a9: Status 404 returned error can't find the container with id dc718d4bc4b30b9ce5370c3cdab936f8dc4f0926a70021f1b1b10f56b6fd55a9
Jul 24 15:09:55.183507 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.183486    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:09:55.204691 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.204652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrwd\" (UniqueName: \"kubernetes.io/projected/8833d1d8-d732-4ef1-a030-e5c06a12a704-kube-api-access-qtrwd\") pod \"payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.204899 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.204709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8833d1d8-d732-4ef1-a030-e5c06a12a704-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.305693 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.305650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrwd\" (UniqueName: \"kubernetes.io/projected/8833d1d8-d732-4ef1-a030-e5c06a12a704-kube-api-access-qtrwd\") pod \"payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.305923 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.305703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8833d1d8-d732-4ef1-a030-e5c06a12a704-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.306489 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.306464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8833d1d8-d732-4ef1-a030-e5c06a12a704-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.314287 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.314222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrwd\" (UniqueName: \"kubernetes.io/projected/8833d1d8-d732-4ef1-a030-e5c06a12a704-kube-api-access-qtrwd\") pod \"payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.374564 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.374530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:55.426820 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.426760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" event={"ID":"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599","Type":"ContainerStarted","Data":"dc718d4bc4b30b9ce5370c3cdab936f8dc4f0926a70021f1b1b10f56b6fd55a9"}
Jul 24 15:09:55.517487 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:55.517460    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"]
Jul 24 15:09:55.519290 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:09:55.519265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8833d1d8_d732_4ef1_a030_e5c06a12a704.slice/crio-6fe565ed25ceac2645af51a4e0a8334cc786f008ad4f85209e29c0cd3a8ce05e WatchSource:0}: Error finding container 6fe565ed25ceac2645af51a4e0a8334cc786f008ad4f85209e29c0cd3a8ce05e: Status 404 returned error can't find the container with id 6fe565ed25ceac2645af51a4e0a8334cc786f008ad4f85209e29c0cd3a8ce05e
Jul 24 15:09:56.434564 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.434527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w" event={"ID":"8833d1d8-d732-4ef1-a030-e5c06a12a704","Type":"ContainerStarted","Data":"4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7"}
Jul 24 15:09:56.435101 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.434608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:09:56.435101 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.434634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w" event={"ID":"8833d1d8-d732-4ef1-a030-e5c06a12a704","Type":"ContainerStarted","Data":"6fe565ed25ceac2645af51a4e0a8334cc786f008ad4f85209e29c0cd3a8ce05e"}
Jul 24 15:09:56.436087 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.436063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" event={"ID":"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599","Type":"ContainerStarted","Data":"87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75"}
Jul 24 15:09:56.436218 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.436199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:09:56.454199 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.454150    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w" podStartSLOduration=1.454133701 podStartE2EDuration="1.454133701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:56.452821347 +0000 UTC m=+2273.804666537" watchObservedRunningTime="2026-07-24 15:09:56.454133701 +0000 UTC m=+2273.805978882"
Jul 24 15:09:56.473096 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:09:56.473036    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" podStartSLOduration=1.82261989 podStartE2EDuration="2.473017397s" totalImagesPullingTime="650.397507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:56.4705385 +0000 UTC m=+2273.822383696" watchObservedRunningTime="2026-07-24 15:09:56.473017397 +0000 UTC m=+2273.824862581"
Jul 24 15:10:02.231239 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.231204    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"]
Jul 24 15:10:02.235333 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.235310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.239546 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.239521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b3c385-serving-cert\""
Jul 24 15:10:02.245447 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.245425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"]
Jul 24 15:10:02.370822 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.370767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdhxc\" (UniqueName: \"kubernetes.io/projected/b8957eef-40ff-40d4-a35d-6d06184f5322-kube-api-access-vdhxc\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.370992 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.370846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8957eef-40ff-40d4-a35d-6d06184f5322-openshift-service-ca\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.370992 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.370873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.447286 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.447254    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:10:02.472162 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.472128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8957eef-40ff-40d4-a35d-6d06184f5322-openshift-service-ca\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.472337 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.472173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.472337 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.472241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdhxc\" (UniqueName: \"kubernetes.io/projected/b8957eef-40ff-40d4-a35d-6d06184f5322-kube-api-access-vdhxc\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.472417 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:10:02.472363    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-serving-cert: secret "maas-api-e2e-api-b-b3c385-serving-cert" not found
Jul 24 15:10:02.472449 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:10:02.472428    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls podName:b8957eef-40ff-40d4-a35d-6d06184f5322 nodeName:}" failed. No retries permitted until 2026-07-24 15:10:02.972408709 +0000 UTC m=+2280.324253877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls") pod "maas-api-e2e-api-b-b3c385-7846844594-b8wj6" (UID: "b8957eef-40ff-40d4-a35d-6d06184f5322") : secret "maas-api-e2e-api-b-b3c385-serving-cert" not found
Jul 24 15:10:02.472767 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.472748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8957eef-40ff-40d4-a35d-6d06184f5322-openshift-service-ca\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.482152 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.482074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdhxc\" (UniqueName: \"kubernetes.io/projected/b8957eef-40ff-40d4-a35d-6d06184f5322-kube-api-access-vdhxc\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.978130 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.978098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:02.980596 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:02.980565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls\") pod \"maas-api-e2e-api-b-b3c385-7846844594-b8wj6\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:03.147505 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.147454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:03.317555 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.317530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"]
Jul 24 15:10:03.320011 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:10:03.319980    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8957eef_40ff_40d4_a35d_6d06184f5322.slice/crio-9ac23a996c70160958e65a2de44deb02eab2d2c521714d43083ad6257063af55 WatchSource:0}: Error finding container 9ac23a996c70160958e65a2de44deb02eab2d2c521714d43083ad6257063af55: Status 404 returned error can't find the container with id 9ac23a996c70160958e65a2de44deb02eab2d2c521714d43083ad6257063af55
Jul 24 15:10:03.344268 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.344237    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"]
Jul 24 15:10:03.348913 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.348888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.352634 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.352613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-b3c385-dockercfg-8frpn\""
Jul 24 15:10:03.352730 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.352613    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-b3c385\""
Jul 24 15:10:03.381245 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.381206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"]
Jul 24 15:10:03.472740 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.472710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6" event={"ID":"b8957eef-40ff-40d4-a35d-6d06184f5322","Type":"ContainerStarted","Data":"9ac23a996c70160958e65a2de44deb02eab2d2c521714d43083ad6257063af55"}
Jul 24 15:10:03.482217 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.482187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") " pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.482375 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.482232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76r8g\" (UniqueName: \"kubernetes.io/projected/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-kube-api-access-76r8g\") pod \"payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") " pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.583302 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.583210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") " pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.583302 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.583255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76r8g\" (UniqueName: \"kubernetes.io/projected/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-kube-api-access-76r8g\") pod \"payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") " pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.583963 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.583943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") " pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.603175 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.603142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76r8g\" (UniqueName: \"kubernetes.io/projected/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-kube-api-access-76r8g\") pod \"payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") " pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.661804 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.661750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:03.854659 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:10:03.854613    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0bd01e_c5f5_4ca1_8be6_c2c10d461e5f.slice/crio-337a3c231d911a63bf884c783961d82383246360df11dc76cfdc1d0c9e45acad WatchSource:0}: Error finding container 337a3c231d911a63bf884c783961d82383246360df11dc76cfdc1d0c9e45acad: Status 404 returned error can't find the container with id 337a3c231d911a63bf884c783961d82383246360df11dc76cfdc1d0c9e45acad
Jul 24 15:10:03.861072 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:03.861039    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"]
Jul 24 15:10:04.480442 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:04.480408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg" event={"ID":"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f","Type":"ContainerStarted","Data":"a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc"}
Jul 24 15:10:04.480905 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:04.480467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg" event={"ID":"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f","Type":"ContainerStarted","Data":"337a3c231d911a63bf884c783961d82383246360df11dc76cfdc1d0c9e45acad"}
Jul 24 15:10:04.480905 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:04.480516    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:05.487050 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:05.487005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6" event={"ID":"b8957eef-40ff-40d4-a35d-6d06184f5322","Type":"ContainerStarted","Data":"50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0"}
Jul 24 15:10:05.487542 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:05.487313    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:05.507657 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:05.507599    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6" podStartSLOduration=2.404236682 podStartE2EDuration="3.507582999s" totalImagesPullingTime="1.103346317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:05.504830593 +0000 UTC m=+2282.856675799" watchObservedRunningTime="2026-07-24 15:10:05.507582999 +0000 UTC m=+2282.859428184"
Jul 24 15:10:05.507865 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:05.507684    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg" podStartSLOduration=2.507680497 podStartE2EDuration="2.507680497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:04.51148383 +0000 UTC m=+2281.863329016" watchObservedRunningTime="2026-07-24 15:10:05.507680497 +0000 UTC m=+2282.859525681"
Jul 24 15:10:07.444126 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:07.444098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:10:11.497738 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:11.497707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:15.489254 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:15.489218    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:31.017043 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.017008    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"]
Jul 24 15:10:31.017462 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.017249    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" podUID="eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" containerName="maas-api" containerID="cri-o://87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75" gracePeriod=30
Jul 24 15:10:31.077393 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.077363    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"]
Jul 24 15:10:31.077572 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.077547    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w" podUID="8833d1d8-d732-4ef1-a030-e5c06a12a704" containerName="payload-pre-processing" containerID="cri-o://4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7" gracePeriod=30
Jul 24 15:10:31.326012 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.325984    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:10:31.353472 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.353449    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:10:31.428411 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.428376    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-openshift-service-ca\") pod \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") "
Jul 24 15:10:31.428601 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.428421    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtrwd\" (UniqueName: \"kubernetes.io/projected/8833d1d8-d732-4ef1-a030-e5c06a12a704-kube-api-access-qtrwd\") pod \"8833d1d8-d732-4ef1-a030-e5c06a12a704\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") "
Jul 24 15:10:31.428601 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.428474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn7n4\" (UniqueName: \"kubernetes.io/projected/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-kube-api-access-fn7n4\") pod \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") "
Jul 24 15:10:31.428601 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.428516    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls\") pod \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\" (UID: \"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599\") "
Jul 24 15:10:31.428816 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.428650    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8833d1d8-d732-4ef1-a030-e5c06a12a704-plugins-config-volume\") pod \"8833d1d8-d732-4ef1-a030-e5c06a12a704\" (UID: \"8833d1d8-d732-4ef1-a030-e5c06a12a704\") "
Jul 24 15:10:31.428816 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.428773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" (UID: "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:10:31.429031 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.429010    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:31.429108 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.429059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8833d1d8-d732-4ef1-a030-e5c06a12a704-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8833d1d8-d732-4ef1-a030-e5c06a12a704" (UID: "8833d1d8-d732-4ef1-a030-e5c06a12a704"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:10:31.430556 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.430533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" (UID: "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:10:31.430556 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.430544    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-kube-api-access-fn7n4" (OuterVolumeSpecName: "kube-api-access-fn7n4") pod "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" (UID: "eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599"). InnerVolumeSpecName "kube-api-access-fn7n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:10:31.430693 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.430575    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8833d1d8-d732-4ef1-a030-e5c06a12a704-kube-api-access-qtrwd" (OuterVolumeSpecName: "kube-api-access-qtrwd") pod "8833d1d8-d732-4ef1-a030-e5c06a12a704" (UID: "8833d1d8-d732-4ef1-a030-e5c06a12a704"). InnerVolumeSpecName "kube-api-access-qtrwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:10:31.530380 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.530344    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtrwd\" (UniqueName: \"kubernetes.io/projected/8833d1d8-d732-4ef1-a030-e5c06a12a704-kube-api-access-qtrwd\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:31.530380 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.530374    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn7n4\" (UniqueName: \"kubernetes.io/projected/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-kube-api-access-fn7n4\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:31.530380 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.530384    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:31.530620 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.530394    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8833d1d8-d732-4ef1-a030-e5c06a12a704-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:31.622021 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.621937    2580 generic.go:356] "Generic (PLEG): container finished" podID="8833d1d8-d732-4ef1-a030-e5c06a12a704" containerID="4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7" exitCode=0
Jul 24 15:10:31.622021 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.621980    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"
Jul 24 15:10:31.622253 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.622032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w" event={"ID":"8833d1d8-d732-4ef1-a030-e5c06a12a704","Type":"ContainerDied","Data":"4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7"}
Jul 24 15:10:31.622253 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.622094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w" event={"ID":"8833d1d8-d732-4ef1-a030-e5c06a12a704","Type":"ContainerDied","Data":"6fe565ed25ceac2645af51a4e0a8334cc786f008ad4f85209e29c0cd3a8ce05e"}
Jul 24 15:10:31.622253 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.622114    2580 scope.go:117] "RemoveContainer" containerID="4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7"
Jul 24 15:10:31.623454 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.623432    2580 generic.go:356] "Generic (PLEG): container finished" podID="eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" containerID="87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75" exitCode=0
Jul 24 15:10:31.623566 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.623485    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"
Jul 24 15:10:31.623566 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.623506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" event={"ID":"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599","Type":"ContainerDied","Data":"87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75"}
Jul 24 15:10:31.623566 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.623555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8" event={"ID":"eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599","Type":"ContainerDied","Data":"dc718d4bc4b30b9ce5370c3cdab936f8dc4f0926a70021f1b1b10f56b6fd55a9"}
Jul 24 15:10:31.631129 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.631114    2580 scope.go:117] "RemoveContainer" containerID="4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7"
Jul 24 15:10:31.631407 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:10:31.631380    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7\": container with ID starting with 4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7 not found: ID does not exist" containerID="4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7"
Jul 24 15:10:31.631515 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.631414    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7"} err="failed to get container status \"4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7\": rpc error: code = NotFound desc = could not find container \"4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7\": container with ID starting with 4e41db3d14864c988d6ed395077121d7f449613e8e8896ccfd065946daa561a7 not found: ID does not exist"
Jul 24 15:10:31.631515 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.631431    2580 scope.go:117] "RemoveContainer" containerID="87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75"
Jul 24 15:10:31.640025 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.640007    2580 scope.go:117] "RemoveContainer" containerID="87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75"
Jul 24 15:10:31.640279 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:10:31.640262    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75\": container with ID starting with 87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75 not found: ID does not exist" containerID="87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75"
Jul 24 15:10:31.640326 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.640289    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75"} err="failed to get container status \"87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75\": rpc error: code = NotFound desc = could not find container \"87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75\": container with ID starting with 87fd25a66d0c391c590e93f3a99a8cf82a5a47a83864e84955edb21207e7ee75 not found: ID does not exist"
Jul 24 15:10:31.647904 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.647883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"]
Jul 24 15:10:31.651956 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.651926    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b1e6f9-5c567c6d5b-qnw2w"]
Jul 24 15:10:31.661899 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.661875    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"]
Jul 24 15:10:31.665802 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:31.665774    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b1e6f9-97b796948-n9vp8"]
Jul 24 15:10:33.065731 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:33.065701    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8833d1d8-d732-4ef1-a030-e5c06a12a704" path="/var/lib/kubelet/pods/8833d1d8-d732-4ef1-a030-e5c06a12a704/volumes"
Jul 24 15:10:33.066116 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:33.066084    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" path="/var/lib/kubelet/pods/eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599/volumes"
Jul 24 15:10:58.724531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:58.724450    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"]
Jul 24 15:10:58.725003 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:58.724702    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6" podUID="b8957eef-40ff-40d4-a35d-6d06184f5322" containerName="maas-api" containerID="cri-o://50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0" gracePeriod=30
Jul 24 15:10:58.839805 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:58.839756    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"]
Jul 24 15:10:58.840005 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:58.839976    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg" podUID="bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" containerName="payload-processing" containerID="cri-o://a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc" gracePeriod=30
Jul 24 15:10:58.995917 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:58.995884    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:59.110697 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.110668    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:59.176673 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.176637    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8957eef-40ff-40d4-a35d-6d06184f5322-openshift-service-ca\") pod \"b8957eef-40ff-40d4-a35d-6d06184f5322\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") "
Jul 24 15:10:59.176868 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.176700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls\") pod \"b8957eef-40ff-40d4-a35d-6d06184f5322\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") "
Jul 24 15:10:59.176868 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.176750    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdhxc\" (UniqueName: \"kubernetes.io/projected/b8957eef-40ff-40d4-a35d-6d06184f5322-kube-api-access-vdhxc\") pod \"b8957eef-40ff-40d4-a35d-6d06184f5322\" (UID: \"b8957eef-40ff-40d4-a35d-6d06184f5322\") "
Jul 24 15:10:59.177049 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.177026    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8957eef-40ff-40d4-a35d-6d06184f5322-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8957eef-40ff-40d4-a35d-6d06184f5322" (UID: "b8957eef-40ff-40d4-a35d-6d06184f5322"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:10:59.178779 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.178748    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8957eef-40ff-40d4-a35d-6d06184f5322" (UID: "b8957eef-40ff-40d4-a35d-6d06184f5322"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:10:59.178946 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.178843    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8957eef-40ff-40d4-a35d-6d06184f5322-kube-api-access-vdhxc" (OuterVolumeSpecName: "kube-api-access-vdhxc") pod "b8957eef-40ff-40d4-a35d-6d06184f5322" (UID: "b8957eef-40ff-40d4-a35d-6d06184f5322"). InnerVolumeSpecName "kube-api-access-vdhxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:10:59.277934 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.277845    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-plugins-config-volume\") pod \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") "
Jul 24 15:10:59.277934 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.277930    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76r8g\" (UniqueName: \"kubernetes.io/projected/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-kube-api-access-76r8g\") pod \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\" (UID: \"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f\") "
Jul 24 15:10:59.278204 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.278184    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8957eef-40ff-40d4-a35d-6d06184f5322-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:59.278270 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.278210    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdhxc\" (UniqueName: \"kubernetes.io/projected/b8957eef-40ff-40d4-a35d-6d06184f5322-kube-api-access-vdhxc\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:59.278270 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.278226    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8957eef-40ff-40d4-a35d-6d06184f5322-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:59.278361 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.278307    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" (UID: "bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:10:59.279951 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.279930    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-kube-api-access-76r8g" (OuterVolumeSpecName: "kube-api-access-76r8g") pod "bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" (UID: "bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f"). InnerVolumeSpecName "kube-api-access-76r8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:10:59.379388 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.379347    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:59.379388 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.379378    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76r8g\" (UniqueName: \"kubernetes.io/projected/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f-kube-api-access-76r8g\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:10:59.781268 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.781236    2580 generic.go:356] "Generic (PLEG): container finished" podID="b8957eef-40ff-40d4-a35d-6d06184f5322" containerID="50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0" exitCode=0
Jul 24 15:10:59.781726 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.781284    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"
Jul 24 15:10:59.781726 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.781321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6" event={"ID":"b8957eef-40ff-40d4-a35d-6d06184f5322","Type":"ContainerDied","Data":"50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0"}
Jul 24 15:10:59.781726 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.781373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6" event={"ID":"b8957eef-40ff-40d4-a35d-6d06184f5322","Type":"ContainerDied","Data":"9ac23a996c70160958e65a2de44deb02eab2d2c521714d43083ad6257063af55"}
Jul 24 15:10:59.781726 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.781398    2580 scope.go:117] "RemoveContainer" containerID="50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0"
Jul 24 15:10:59.782841 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.782822    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" containerID="a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc" exitCode=0
Jul 24 15:10:59.782912 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.782863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg" event={"ID":"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f","Type":"ContainerDied","Data":"a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc"}
Jul 24 15:10:59.782912 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.782904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg" event={"ID":"bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f","Type":"ContainerDied","Data":"337a3c231d911a63bf884c783961d82383246360df11dc76cfdc1d0c9e45acad"}
Jul 24 15:10:59.782997 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.782936    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"
Jul 24 15:10:59.791914 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.791781    2580 scope.go:117] "RemoveContainer" containerID="50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0"
Jul 24 15:10:59.792188 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:10:59.792163    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0\": container with ID starting with 50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0 not found: ID does not exist" containerID="50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0"
Jul 24 15:10:59.792252 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.792200    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0"} err="failed to get container status \"50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0\": rpc error: code = NotFound desc = could not find container \"50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0\": container with ID starting with 50560f86e5145ca849296ed26d7d9ce46c4279aa7ccafa5fca4bfb7e29a1ded0 not found: ID does not exist"
Jul 24 15:10:59.792252 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.792224    2580 scope.go:117] "RemoveContainer" containerID="a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc"
Jul 24 15:10:59.800078 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.800062    2580 scope.go:117] "RemoveContainer" containerID="a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc"
Jul 24 15:10:59.800298 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:10:59.800275    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc\": container with ID starting with a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc not found: ID does not exist" containerID="a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc"
Jul 24 15:10:59.800360 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.800304    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc"} err="failed to get container status \"a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc\": rpc error: code = NotFound desc = could not find container \"a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc\": container with ID starting with a97cd0405f825d2a6c50a5ca405d66432c07850056ad7f987cbacfeaf76282cc not found: ID does not exist"
Jul 24 15:10:59.804690 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.804670    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"]
Jul 24 15:10:59.809475 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.809452    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b3c385-7846844594-b8wj6"]
Jul 24 15:10:59.819907 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.819883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"]
Jul 24 15:10:59.824093 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:10:59.824071    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b3c385-7b89696798-r4fsg"]
Jul 24 15:11:01.064726 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:01.064694    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8957eef-40ff-40d4-a35d-6d06184f5322" path="/var/lib/kubelet/pods/b8957eef-40ff-40d4-a35d-6d06184f5322/volumes"
Jul 24 15:11:01.065196 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:01.065093    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" path="/var/lib/kubelet/pods/bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f/volumes"
Jul 24 15:11:14.650281 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650244    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"]
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650606    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" containerName="payload-processing"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650617    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" containerName="payload-processing"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650628    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" containerName="maas-api"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650633    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" containerName="maas-api"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650641    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8957eef-40ff-40d4-a35d-6d06184f5322" containerName="maas-api"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650647    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8957eef-40ff-40d4-a35d-6d06184f5322" containerName="maas-api"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650662    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8833d1d8-d732-4ef1-a030-e5c06a12a704" containerName="payload-pre-processing"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650670    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8833d1d8-d732-4ef1-a030-e5c06a12a704" containerName="payload-pre-processing"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650743    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8957eef-40ff-40d4-a35d-6d06184f5322" containerName="maas-api"
Jul 24 15:11:14.650746 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650752    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8833d1d8-d732-4ef1-a030-e5c06a12a704" containerName="payload-pre-processing"
Jul 24 15:11:14.651296 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650759    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0bd01e-c5f5-4ca1-8be6-c2c10d461e5f" containerName="payload-processing"
Jul 24 15:11:14.651296 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.650767    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb50a57-3f2b-4c86-b1bb-2ecba7f2b599" containerName="maas-api"
Jul 24 15:11:14.653834 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.653813    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.656378 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.656355    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-dc7d81-serving-cert\""
Jul 24 15:11:14.666765 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.666743    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"]
Jul 24 15:11:14.712098 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.712064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48bc583-53cd-42d9-9ea3-55b795a8d86b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.712291 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.712106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r8qj\" (UniqueName: \"kubernetes.io/projected/e48bc583-53cd-42d9-9ea3-55b795a8d86b-kube-api-access-9r8qj\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.712291 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.712176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.812998 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.812964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48bc583-53cd-42d9-9ea3-55b795a8d86b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.813213 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.813009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r8qj\" (UniqueName: \"kubernetes.io/projected/e48bc583-53cd-42d9-9ea3-55b795a8d86b-kube-api-access-9r8qj\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.813213 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.813135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.813340 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:11:14.813258    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-serving-cert: secret "maas-api-e2e-shared-a-dc7d81-serving-cert" not found
Jul 24 15:11:14.813340 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:11:14.813322    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls podName:e48bc583-53cd-42d9-9ea3-55b795a8d86b nodeName:}" failed. No retries permitted until 2026-07-24 15:11:15.313304265 +0000 UTC m=+2352.665149434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls") pod "maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" (UID: "e48bc583-53cd-42d9-9ea3-55b795a8d86b") : secret "maas-api-e2e-shared-a-dc7d81-serving-cert" not found
Jul 24 15:11:14.813744 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.813721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48bc583-53cd-42d9-9ea3-55b795a8d86b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:14.826168 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:14.826136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r8qj\" (UniqueName: \"kubernetes.io/projected/e48bc583-53cd-42d9-9ea3-55b795a8d86b-kube-api-access-9r8qj\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:15.317389 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:15.317351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:15.319975 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:15.319941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:15.563987 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:15.563955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:15.719847 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:15.719810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"]
Jul 24 15:11:15.723271 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:11:15.723244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48bc583_53cd_42d9_9ea3_55b795a8d86b.slice/crio-ba2072123fb5241640b352e1638d68f6c4e15df202a482b33a4be0ab051483ca WatchSource:0}: Error finding container ba2072123fb5241640b352e1638d68f6c4e15df202a482b33a4be0ab051483ca: Status 404 returned error can't find the container with id ba2072123fb5241640b352e1638d68f6c4e15df202a482b33a4be0ab051483ca
Jul 24 15:11:15.865889 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:15.865786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" event={"ID":"e48bc583-53cd-42d9-9ea3-55b795a8d86b","Type":"ContainerStarted","Data":"ba2072123fb5241640b352e1638d68f6c4e15df202a482b33a4be0ab051483ca"}
Jul 24 15:11:16.873177 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:16.873137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" event={"ID":"e48bc583-53cd-42d9-9ea3-55b795a8d86b","Type":"ContainerStarted","Data":"7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e"}
Jul 24 15:11:16.873596 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:16.873243    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:16.891588 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:16.891538    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" podStartSLOduration=2.396274714 podStartE2EDuration="2.891523969s" totalImagesPullingTime="495.249255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:16.890511402 +0000 UTC m=+2354.242356600" watchObservedRunningTime="2026-07-24 15:11:16.891523969 +0000 UTC m=+2354.243369156"
Jul 24 15:11:22.883866 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:22.883833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:11:23.578067 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.578034    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"]
Jul 24 15:11:23.581541 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.581518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.587382 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.587357    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8ea489-serving-cert\""
Jul 24 15:11:23.598055 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.598030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"]
Jul 24 15:11:23.698478 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.698446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmv8p\" (UniqueName: \"kubernetes.io/projected/92835b54-9c8e-47e9-ad5e-61623513eaf0-kube-api-access-wmv8p\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.698652 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.698503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.698652 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.698549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92835b54-9c8e-47e9-ad5e-61623513eaf0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.799184 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.799150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.799184 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.799188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92835b54-9c8e-47e9-ad5e-61623513eaf0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.799390 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.799267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmv8p\" (UniqueName: \"kubernetes.io/projected/92835b54-9c8e-47e9-ad5e-61623513eaf0-kube-api-access-wmv8p\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.799390 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:11:23.799294    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-serving-cert: secret "maas-api-e2e-shared-b-8ea489-serving-cert" not found
Jul 24 15:11:23.799390 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:11:23.799353    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls podName:92835b54-9c8e-47e9-ad5e-61623513eaf0 nodeName:}" failed. No retries permitted until 2026-07-24 15:11:24.29933743 +0000 UTC m=+2361.651182594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls") pod "maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" (UID: "92835b54-9c8e-47e9-ad5e-61623513eaf0") : secret "maas-api-e2e-shared-b-8ea489-serving-cert" not found
Jul 24 15:11:23.799857 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.799840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92835b54-9c8e-47e9-ad5e-61623513eaf0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:23.810076 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:23.810046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmv8p\" (UniqueName: \"kubernetes.io/projected/92835b54-9c8e-47e9-ad5e-61623513eaf0-kube-api-access-wmv8p\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:24.304478 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.304438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:24.306940 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.306914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:24.366988 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.366948    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"]
Jul 24 15:11:24.370478 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.370456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.372988 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.372957    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-8ea489\""
Jul 24 15:11:24.380141 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.380114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"]
Jul 24 15:11:24.404427 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.404387    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"]
Jul 24 15:11:24.407531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.407513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.413184 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.413165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-8ea489-dockercfg-5kzsq\""
Jul 24 15:11:24.424514 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.424490    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"]
Jul 24 15:11:24.493265 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.493233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:24.506776 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.506688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l59tj\" (UniqueName: \"kubernetes.io/projected/78884742-4fdb-4917-88d5-c4094288a0b4-kube-api-access-l59tj\") pod \"payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.506907 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.506778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78884742-4fdb-4917-88d5-c4094288a0b4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.506907 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.506826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv88l\" (UniqueName: \"kubernetes.io/projected/b7281fdc-0367-4b6f-8700-1c75d0017aa6-kube-api-access-qv88l\") pod \"payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.506907 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.506877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7281fdc-0367-4b6f-8700-1c75d0017aa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.607590 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.607559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l59tj\" (UniqueName: \"kubernetes.io/projected/78884742-4fdb-4917-88d5-c4094288a0b4-kube-api-access-l59tj\") pod \"payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.607778 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.607623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78884742-4fdb-4917-88d5-c4094288a0b4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.607778 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.607653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv88l\" (UniqueName: \"kubernetes.io/projected/b7281fdc-0367-4b6f-8700-1c75d0017aa6-kube-api-access-qv88l\") pod \"payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.607778 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.607697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7281fdc-0367-4b6f-8700-1c75d0017aa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.608455 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.608408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78884742-4fdb-4917-88d5-c4094288a0b4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.608557 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.608470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7281fdc-0367-4b6f-8700-1c75d0017aa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.616908 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.616882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l59tj\" (UniqueName: \"kubernetes.io/projected/78884742-4fdb-4917-88d5-c4094288a0b4-kube-api-access-l59tj\") pod \"payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.617026 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.616975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv88l\" (UniqueName: \"kubernetes.io/projected/b7281fdc-0367-4b6f-8700-1c75d0017aa6-kube-api-access-qv88l\") pod \"payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.638295 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.638266    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"]
Jul 24 15:11:24.639760 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:11:24.639733    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92835b54_9c8e_47e9_ad5e_61623513eaf0.slice/crio-d5b115f4143fe503c29f210702e6e0a91fdc9e99333bee394978d514d116663f WatchSource:0}: Error finding container d5b115f4143fe503c29f210702e6e0a91fdc9e99333bee394978d514d116663f: Status 404 returned error can't find the container with id d5b115f4143fe503c29f210702e6e0a91fdc9e99333bee394978d514d116663f
Jul 24 15:11:24.682404 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.682378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.717238 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.717193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:24.844065 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.844038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"]
Jul 24 15:11:24.845825 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:11:24.845758    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7281fdc_0367_4b6f_8700_1c75d0017aa6.slice/crio-4c334f41eed11dac3ec41b8d25fe8017002b80fb785c7f236b1db51d87777af8 WatchSource:0}: Error finding container 4c334f41eed11dac3ec41b8d25fe8017002b80fb785c7f236b1db51d87777af8: Status 404 returned error can't find the container with id 4c334f41eed11dac3ec41b8d25fe8017002b80fb785c7f236b1db51d87777af8
Jul 24 15:11:24.916727 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.916696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" event={"ID":"92835b54-9c8e-47e9-ad5e-61623513eaf0","Type":"ContainerStarted","Data":"d5b115f4143fe503c29f210702e6e0a91fdc9e99333bee394978d514d116663f"}
Jul 24 15:11:24.918193 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.918171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr" event={"ID":"b7281fdc-0367-4b6f-8700-1c75d0017aa6","Type":"ContainerStarted","Data":"4c334f41eed11dac3ec41b8d25fe8017002b80fb785c7f236b1db51d87777af8"}
Jul 24 15:11:24.918324 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.918309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:24.990690 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:24.990634    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr" podStartSLOduration=0.990617475 podStartE2EDuration="990.617475ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:24.969457629 +0000 UTC m=+2362.321302814" watchObservedRunningTime="2026-07-24 15:11:24.990617475 +0000 UTC m=+2362.342462660"
Jul 24 15:11:25.086707 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.086684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"]
Jul 24 15:11:25.088180 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:11:25.088155    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78884742_4fdb_4917_88d5_c4094288a0b4.slice/crio-c788c7b17d7106193c08e5d32dbceb3bd602fcbe5aea4fe3180451b090936333 WatchSource:0}: Error finding container c788c7b17d7106193c08e5d32dbceb3bd602fcbe5aea4fe3180451b090936333: Status 404 returned error can't find the container with id c788c7b17d7106193c08e5d32dbceb3bd602fcbe5aea4fe3180451b090936333
Jul 24 15:11:25.924401 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.924362    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" event={"ID":"92835b54-9c8e-47e9-ad5e-61623513eaf0","Type":"ContainerStarted","Data":"91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b"}
Jul 24 15:11:25.924897 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.924429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:25.926104 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.926080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr" event={"ID":"b7281fdc-0367-4b6f-8700-1c75d0017aa6","Type":"ContainerStarted","Data":"c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775"}
Jul 24 15:11:25.927505 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.927485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv" event={"ID":"78884742-4fdb-4917-88d5-c4094288a0b4","Type":"ContainerStarted","Data":"70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa"}
Jul 24 15:11:25.927595 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.927527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:11:25.927595 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.927545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv" event={"ID":"78884742-4fdb-4917-88d5-c4094288a0b4","Type":"ContainerStarted","Data":"c788c7b17d7106193c08e5d32dbceb3bd602fcbe5aea4fe3180451b090936333"}
Jul 24 15:11:25.947689 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.947631    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" podStartSLOduration=2.56565939 podStartE2EDuration="2.947613193s" totalImagesPullingTime="381.953803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:25.946984642 +0000 UTC m=+2363.298829827" watchObservedRunningTime="2026-07-24 15:11:25.947613193 +0000 UTC m=+2363.299458379"
Jul 24 15:11:25.969842 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:25.969776    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv" podStartSLOduration=1.9697593310000001 podStartE2EDuration="1.969759331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:25.96833363 +0000 UTC m=+2363.320178830" watchObservedRunningTime="2026-07-24 15:11:25.969759331 +0000 UTC m=+2363.321604516"
Jul 24 15:11:31.939079 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:31.939050    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:11:36.935178 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:36.935143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:11:36.935604 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:11:36.935236    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:17:42.163262 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.163230    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"]
Jul 24 15:17:42.166574 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.166556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.169404 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.169386    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-bb95eb-serving-cert\""
Jul 24 15:17:42.180977 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.180952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"]
Jul 24 15:17:42.322827 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.322764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.323027 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.322853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t58gf\" (UniqueName: \"kubernetes.io/projected/4e1bdc34-4f22-4a32-a72a-763a592705b5-kube-api-access-t58gf\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.323027 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.322962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1bdc34-4f22-4a32-a72a-763a592705b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.423522 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.423425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.423522 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.423479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t58gf\" (UniqueName: \"kubernetes.io/projected/4e1bdc34-4f22-4a32-a72a-763a592705b5-kube-api-access-t58gf\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.423522 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.423520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1bdc34-4f22-4a32-a72a-763a592705b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.423854 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:17:42.423592    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-serving-cert: secret "maas-api-e2e-ipp-a-bb95eb-serving-cert" not found
Jul 24 15:17:42.423854 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:17:42.423683    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls podName:4e1bdc34-4f22-4a32-a72a-763a592705b5 nodeName:}" failed. No retries permitted until 2026-07-24 15:17:42.923662137 +0000 UTC m=+2740.275507314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls") pod "maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" (UID: "4e1bdc34-4f22-4a32-a72a-763a592705b5") : secret "maas-api-e2e-ipp-a-bb95eb-serving-cert" not found
Jul 24 15:17:42.424161 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.424145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1bdc34-4f22-4a32-a72a-763a592705b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.434613 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.434586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t58gf\" (UniqueName: \"kubernetes.io/projected/4e1bdc34-4f22-4a32-a72a-763a592705b5-kube-api-access-t58gf\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.844419 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.844331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"]
Jul 24 15:17:42.848026 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.848006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:42.850394 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.850379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bb95eb\""
Jul 24 15:17:42.857722 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.857698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"]
Jul 24 15:17:42.928215 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.928181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhfql\" (UniqueName: \"kubernetes.io/projected/4144f585-70ae-441b-b0c8-89138623f56a-kube-api-access-qhfql\") pod \"payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:42.928416 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.928243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4144f585-70ae-441b-b0c8-89138623f56a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:42.928416 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.928384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:42.930705 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:42.930687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:43.029518 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.029478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhfql\" (UniqueName: \"kubernetes.io/projected/4144f585-70ae-441b-b0c8-89138623f56a-kube-api-access-qhfql\") pod \"payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:43.029705 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.029542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4144f585-70ae-441b-b0c8-89138623f56a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:43.030240 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.030220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4144f585-70ae-441b-b0c8-89138623f56a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:43.037252 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.037227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhfql\" (UniqueName: \"kubernetes.io/projected/4144f585-70ae-441b-b0c8-89138623f56a-kube-api-access-qhfql\") pod \"payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:43.077208 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.077169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:43.160009 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.159965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:43.224721 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.224664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"]
Jul 24 15:17:43.229509 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:17:43.229470    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1bdc34_4f22_4a32_a72a_763a592705b5.slice/crio-328a6ed5d03891cc7af571cc0af147610e936af9cca79d1b9ae5fa7765bab379 WatchSource:0}: Error finding container 328a6ed5d03891cc7af571cc0af147610e936af9cca79d1b9ae5fa7765bab379: Status 404 returned error can't find the container with id 328a6ed5d03891cc7af571cc0af147610e936af9cca79d1b9ae5fa7765bab379
Jul 24 15:17:43.231419 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.231396    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:17:43.312469 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.312438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"]
Jul 24 15:17:43.313552 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:17:43.313528    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4144f585_70ae_441b_b0c8_89138623f56a.slice/crio-cc26bb490741ef907633c4abf3a4ac872610b964b86b2a777600280da0c8364c WatchSource:0}: Error finding container cc26bb490741ef907633c4abf3a4ac872610b964b86b2a777600280da0c8364c: Status 404 returned error can't find the container with id cc26bb490741ef907633c4abf3a4ac872610b964b86b2a777600280da0c8364c
Jul 24 15:17:43.913231 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.913184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" event={"ID":"4e1bdc34-4f22-4a32-a72a-763a592705b5","Type":"ContainerStarted","Data":"716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b"}
Jul 24 15:17:43.913429 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.913262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:43.913429 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.913288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" event={"ID":"4e1bdc34-4f22-4a32-a72a-763a592705b5","Type":"ContainerStarted","Data":"328a6ed5d03891cc7af571cc0af147610e936af9cca79d1b9ae5fa7765bab379"}
Jul 24 15:17:43.914834 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.914785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq" event={"ID":"4144f585-70ae-441b-b0c8-89138623f56a","Type":"ContainerStarted","Data":"c557d9c32b52bb6f14a78fc670bf64927ec34dbbd699d2261449866bb8f6000f"}
Jul 24 15:17:43.914965 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.914859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq" event={"ID":"4144f585-70ae-441b-b0c8-89138623f56a","Type":"ContainerStarted","Data":"cc26bb490741ef907633c4abf3a4ac872610b964b86b2a777600280da0c8364c"}
Jul 24 15:17:43.914965 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.914921    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:17:43.933822 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.933760    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" podStartSLOduration=1.48001 podStartE2EDuration="1.933744901s" totalImagesPullingTime="453.734901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:17:43.930977854 +0000 UTC m=+2741.282823044" watchObservedRunningTime="2026-07-24 15:17:43.933744901 +0000 UTC m=+2741.285590085"
Jul 24 15:17:43.948293 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:43.948203    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq" podStartSLOduration=1.948188095 podStartE2EDuration="1.948188095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:17:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:17:43.947146664 +0000 UTC m=+2741.298992117" watchObservedRunningTime="2026-07-24 15:17:43.948188095 +0000 UTC m=+2741.300033280"
Jul 24 15:17:49.926347 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:49.926316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:17:54.921980 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:17:54.921947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:18:01.503329 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.503291    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"]
Jul 24 15:18:01.508400 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.508373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.510980 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.510958    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-ba0783-serving-cert\""
Jul 24 15:18:01.517695 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.517674    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"]
Jul 24 15:18:01.603248 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.603215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.603458 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.603264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03900e9-3b87-4c80-989b-ca53e7d8dda7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.603458 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.603315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhr9n\" (UniqueName: \"kubernetes.io/projected/f03900e9-3b87-4c80-989b-ca53e7d8dda7-kube-api-access-lhr9n\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.703930 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.703894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03900e9-3b87-4c80-989b-ca53e7d8dda7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.704121 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.703949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhr9n\" (UniqueName: \"kubernetes.io/projected/f03900e9-3b87-4c80-989b-ca53e7d8dda7-kube-api-access-lhr9n\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.704121 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.704063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.704250 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:18:01.704190    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-serving-cert: secret "maas-api-e2e-ipp-b-ba0783-serving-cert" not found
Jul 24 15:18:01.704313 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:18:01.704284    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls podName:f03900e9-3b87-4c80-989b-ca53e7d8dda7 nodeName:}" failed. No retries permitted until 2026-07-24 15:18:02.204260635 +0000 UTC m=+2759.556105817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls") pod "maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" (UID: "f03900e9-3b87-4c80-989b-ca53e7d8dda7") : secret "maas-api-e2e-ipp-b-ba0783-serving-cert" not found
Jul 24 15:18:01.704566 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.704546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03900e9-3b87-4c80-989b-ca53e7d8dda7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:01.712573 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:01.712548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhr9n\" (UniqueName: \"kubernetes.io/projected/f03900e9-3b87-4c80-989b-ca53e7d8dda7-kube-api-access-lhr9n\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:02.209659 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:02.209623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:02.213250 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:02.213221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:02.420716 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:02.420680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:02.571538 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:18:02.571498    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03900e9_3b87_4c80_989b_ca53e7d8dda7.slice/crio-abf40bfc504400d95fd6862a3823f24852f92b63cb8900515f4c71ad618b0acb WatchSource:0}: Error finding container abf40bfc504400d95fd6862a3823f24852f92b63cb8900515f4c71ad618b0acb: Status 404 returned error can't find the container with id abf40bfc504400d95fd6862a3823f24852f92b63cb8900515f4c71ad618b0acb
Jul 24 15:18:02.573622 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:02.573550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"]
Jul 24 15:18:03.026747 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:03.026704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" event={"ID":"f03900e9-3b87-4c80-989b-ca53e7d8dda7","Type":"ContainerStarted","Data":"abf40bfc504400d95fd6862a3823f24852f92b63cb8900515f4c71ad618b0acb"}
Jul 24 15:18:04.033767 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:04.033728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" event={"ID":"f03900e9-3b87-4c80-989b-ca53e7d8dda7","Type":"ContainerStarted","Data":"13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5"}
Jul 24 15:18:04.034197 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:04.033848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:18:04.052281 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:04.052238    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" podStartSLOduration=2.664359761 podStartE2EDuration="3.052223753s" totalImagesPullingTime="387.863992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:18:04.051509958 +0000 UTC m=+2761.403355144" watchObservedRunningTime="2026-07-24 15:18:04.052223753 +0000 UTC m=+2761.404068937"
Jul 24 15:18:10.046512 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:18:10.046485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:19:21.387501 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.387465    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"]
Jul 24 15:19:21.391848 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.391824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.394401 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.394376    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-2edd1c-serving-cert\""
Jul 24 15:19:21.399715 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.399600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"]
Jul 24 15:19:21.457959 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.457918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.458151 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.458002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f78b44-0382-4bd6-93fa-d7e90978a1d3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.458151 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.458069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp4hb\" (UniqueName: \"kubernetes.io/projected/41f78b44-0382-4bd6-93fa-d7e90978a1d3-kube-api-access-zp4hb\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.559171 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.559132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.559354 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.559190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f78b44-0382-4bd6-93fa-d7e90978a1d3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.559354 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.559231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp4hb\" (UniqueName: \"kubernetes.io/projected/41f78b44-0382-4bd6-93fa-d7e90978a1d3-kube-api-access-zp4hb\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.559354 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:19:21.559279    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-serving-cert: secret "maas-api-e2e-ipp-cleanup-2edd1c-serving-cert" not found
Jul 24 15:19:21.559492 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:19:21.559398    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls podName:41f78b44-0382-4bd6-93fa-d7e90978a1d3 nodeName:}" failed. No retries permitted until 2026-07-24 15:19:22.059375987 +0000 UTC m=+2839.411221151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" (UID: "41f78b44-0382-4bd6-93fa-d7e90978a1d3") : secret "maas-api-e2e-ipp-cleanup-2edd1c-serving-cert" not found
Jul 24 15:19:21.559833 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.559780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f78b44-0382-4bd6-93fa-d7e90978a1d3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:21.569198 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:21.569167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp4hb\" (UniqueName: \"kubernetes.io/projected/41f78b44-0382-4bd6-93fa-d7e90978a1d3-kube-api-access-zp4hb\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:22.021571 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.021537    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"]
Jul 24 15:19:22.025090 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.025073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.027277 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.027259    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-2edd1c\""
Jul 24 15:19:22.037567 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.037539    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"]
Jul 24 15:19:22.060021 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.059984    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"]
Jul 24 15:19:22.063218 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.063191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:22.063398 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.063380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.065478 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.065454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:22.066031 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.066010    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-2edd1c-dockercfg-vfgj4\""
Jul 24 15:19:22.072411 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.072390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"]
Jul 24 15:19:22.164775 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.164741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c18472-f92a-4488-8e8c-463f228730f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.165118 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.165094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.165271 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.165245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hvp5\" (UniqueName: \"kubernetes.io/projected/37c18472-f92a-4488-8e8c-463f228730f6-kube-api-access-5hvp5\") pod \"payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.165366 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.165287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl9k6\" (UniqueName: \"kubernetes.io/projected/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-kube-api-access-cl9k6\") pod \"payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.265940 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.265904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hvp5\" (UniqueName: \"kubernetes.io/projected/37c18472-f92a-4488-8e8c-463f228730f6-kube-api-access-5hvp5\") pod \"payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.265940 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.265943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl9k6\" (UniqueName: \"kubernetes.io/projected/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-kube-api-access-cl9k6\") pod \"payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.266210 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.266000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c18472-f92a-4488-8e8c-463f228730f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.266210 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.266048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.266990 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.266965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c18472-f92a-4488-8e8c-463f228730f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.267047 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.266965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.274656 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.274590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl9k6\" (UniqueName: \"kubernetes.io/projected/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-kube-api-access-cl9k6\") pod \"payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.274962 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.274945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hvp5\" (UniqueName: \"kubernetes.io/projected/37c18472-f92a-4488-8e8c-463f228730f6-kube-api-access-5hvp5\") pod \"payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.304907 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.304874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:22.337852 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.337815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:22.385902 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.385873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:22.478317 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.477626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"]
Jul 24 15:19:22.478317 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:19:22.478233    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f78b44_0382_4bd6_93fa_d7e90978a1d3.slice/crio-b030577639b16624e44c80a918c22b18cddd6d5f31583b03d05af95c5156d937 WatchSource:0}: Error finding container b030577639b16624e44c80a918c22b18cddd6d5f31583b03d05af95c5156d937: Status 404 returned error can't find the container with id b030577639b16624e44c80a918c22b18cddd6d5f31583b03d05af95c5156d937
Jul 24 15:19:22.513834 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.513807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"]
Jul 24 15:19:22.516082 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:19:22.516049    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c18472_f92a_4488_8e8c_463f228730f6.slice/crio-152101ea97303efbba33510bd9d7a3bff56ef93cd6bf10f336db541d160a122e WatchSource:0}: Error finding container 152101ea97303efbba33510bd9d7a3bff56ef93cd6bf10f336db541d160a122e: Status 404 returned error can't find the container with id 152101ea97303efbba33510bd9d7a3bff56ef93cd6bf10f336db541d160a122e
Jul 24 15:19:22.558202 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:22.558178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"]
Jul 24 15:19:22.560318 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:19:22.560291    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a7afe4_83af_46e3_bf0f_ad8f66a4c997.slice/crio-a0fe5d23d260a304488a0d4788366df8038e5d11c1f26a8b9553531905e3985a WatchSource:0}: Error finding container a0fe5d23d260a304488a0d4788366df8038e5d11c1f26a8b9553531905e3985a: Status 404 returned error can't find the container with id a0fe5d23d260a304488a0d4788366df8038e5d11c1f26a8b9553531905e3985a
Jul 24 15:19:23.465309 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.465268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc" event={"ID":"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997","Type":"ContainerStarted","Data":"101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560"}
Jul 24 15:19:23.465531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.465335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc" event={"ID":"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997","Type":"ContainerStarted","Data":"a0fe5d23d260a304488a0d4788366df8038e5d11c1f26a8b9553531905e3985a"}
Jul 24 15:19:23.465531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.465409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:23.467157 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.467128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4" event={"ID":"37c18472-f92a-4488-8e8c-463f228730f6","Type":"ContainerStarted","Data":"4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22"}
Jul 24 15:19:23.467285 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.467179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4" event={"ID":"37c18472-f92a-4488-8e8c-463f228730f6","Type":"ContainerStarted","Data":"152101ea97303efbba33510bd9d7a3bff56ef93cd6bf10f336db541d160a122e"}
Jul 24 15:19:23.467285 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.467233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:23.468852 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.468828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" event={"ID":"41f78b44-0382-4bd6-93fa-d7e90978a1d3","Type":"ContainerStarted","Data":"c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72"}
Jul 24 15:19:23.468982 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.468869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" event={"ID":"41f78b44-0382-4bd6-93fa-d7e90978a1d3","Type":"ContainerStarted","Data":"b030577639b16624e44c80a918c22b18cddd6d5f31583b03d05af95c5156d937"}
Jul 24 15:19:23.468982 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.468897    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:23.491283 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.491232    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc" podStartSLOduration=1.491216201 podStartE2EDuration="1.491216201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:19:23.490280897 +0000 UTC m=+2840.842126082" watchObservedRunningTime="2026-07-24 15:19:23.491216201 +0000 UTC m=+2840.843061364"
Jul 24 15:19:23.514071 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.514023    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4" podStartSLOduration=1.514007559 podStartE2EDuration="1.514007559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:19:23.511986133 +0000 UTC m=+2840.863831320" watchObservedRunningTime="2026-07-24 15:19:23.514007559 +0000 UTC m=+2840.865852743"
Jul 24 15:19:23.538933 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:23.538858    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" podStartSLOduration=2.220221425 podStartE2EDuration="2.538835921s" totalImagesPullingTime="318.614496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:19:23.536906993 +0000 UTC m=+2840.888752178" watchObservedRunningTime="2026-07-24 15:19:23.538835921 +0000 UTC m=+2840.890681107"
Jul 24 15:19:29.481881 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:29.481849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:34.477907 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:34.477874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:34.478454 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:34.477957    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:51.948442 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:51.948403    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"]
Jul 24 15:19:51.948994 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:51.948671    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" podUID="41f78b44-0382-4bd6-93fa-d7e90978a1d3" containerName="maas-api" containerID="cri-o://c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72" gracePeriod=30
Jul 24 15:19:52.017859 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.017821    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"]
Jul 24 15:19:52.018150 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.018097    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc" podUID="a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" containerName="payload-processing" containerID="cri-o://101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560" gracePeriod=30
Jul 24 15:19:52.027167 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.027136    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"]
Jul 24 15:19:52.027398 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.027375    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4" podUID="37c18472-f92a-4488-8e8c-463f228730f6" containerName="payload-pre-processing" containerID="cri-o://4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22" gracePeriod=30
Jul 24 15:19:52.296527 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.296499    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:52.342782 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.342721    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:52.347383 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.347347    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:52.463344 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f78b44-0382-4bd6-93fa-d7e90978a1d3-openshift-service-ca\") pod \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") "
Jul 24 15:19:52.463344 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl9k6\" (UniqueName: \"kubernetes.io/projected/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-kube-api-access-cl9k6\") pod \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") "
Jul 24 15:19:52.463600 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463425    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c18472-f92a-4488-8e8c-463f228730f6-plugins-config-volume\") pod \"37c18472-f92a-4488-8e8c-463f228730f6\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") "
Jul 24 15:19:52.463600 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls\") pod \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") "
Jul 24 15:19:52.463600 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-plugins-config-volume\") pod \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\" (UID: \"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997\") "
Jul 24 15:19:52.463600 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463500    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hvp5\" (UniqueName: \"kubernetes.io/projected/37c18472-f92a-4488-8e8c-463f228730f6-kube-api-access-5hvp5\") pod \"37c18472-f92a-4488-8e8c-463f228730f6\" (UID: \"37c18472-f92a-4488-8e8c-463f228730f6\") "
Jul 24 15:19:52.463600 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp4hb\" (UniqueName: \"kubernetes.io/projected/41f78b44-0382-4bd6-93fa-d7e90978a1d3-kube-api-access-zp4hb\") pod \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\" (UID: \"41f78b44-0382-4bd6-93fa-d7e90978a1d3\") "
Jul 24 15:19:52.463922 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f78b44-0382-4bd6-93fa-d7e90978a1d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41f78b44-0382-4bd6-93fa-d7e90978a1d3" (UID: "41f78b44-0382-4bd6-93fa-d7e90978a1d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:19:52.463922 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.463896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c18472-f92a-4488-8e8c-463f228730f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37c18472-f92a-4488-8e8c-463f228730f6" (UID: "37c18472-f92a-4488-8e8c-463f228730f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:19:52.464249 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.464222    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" (UID: "a6a7afe4-83af-46e3-bf0f-ad8f66a4c997"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:19:52.465743 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.465716    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41f78b44-0382-4bd6-93fa-d7e90978a1d3" (UID: "41f78b44-0382-4bd6-93fa-d7e90978a1d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:19:52.465743 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.465734    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-kube-api-access-cl9k6" (OuterVolumeSpecName: "kube-api-access-cl9k6") pod "a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" (UID: "a6a7afe4-83af-46e3-bf0f-ad8f66a4c997"). InnerVolumeSpecName "kube-api-access-cl9k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:19:52.466100 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.466080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c18472-f92a-4488-8e8c-463f228730f6-kube-api-access-5hvp5" (OuterVolumeSpecName: "kube-api-access-5hvp5") pod "37c18472-f92a-4488-8e8c-463f228730f6" (UID: "37c18472-f92a-4488-8e8c-463f228730f6"). InnerVolumeSpecName "kube-api-access-5hvp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:19:52.466100 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.466085    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f78b44-0382-4bd6-93fa-d7e90978a1d3-kube-api-access-zp4hb" (OuterVolumeSpecName: "kube-api-access-zp4hb") pod "41f78b44-0382-4bd6-93fa-d7e90978a1d3" (UID: "41f78b44-0382-4bd6-93fa-d7e90978a1d3"). InnerVolumeSpecName "kube-api-access-zp4hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:19:52.565140 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565048    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41f78b44-0382-4bd6-93fa-d7e90978a1d3-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.565140 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565084    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.565140 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565098    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hvp5\" (UniqueName: \"kubernetes.io/projected/37c18472-f92a-4488-8e8c-463f228730f6-kube-api-access-5hvp5\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.565140 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565109    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp4hb\" (UniqueName: \"kubernetes.io/projected/41f78b44-0382-4bd6-93fa-d7e90978a1d3-kube-api-access-zp4hb\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.565140 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565123    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f78b44-0382-4bd6-93fa-d7e90978a1d3-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.565140 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565135    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl9k6\" (UniqueName: \"kubernetes.io/projected/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997-kube-api-access-cl9k6\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.565452 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.565147    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c18472-f92a-4488-8e8c-463f228730f6-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:19:52.647167 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.647132    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" containerID="101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560" exitCode=0
Jul 24 15:19:52.647363 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.647171    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"
Jul 24 15:19:52.647363 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.647205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc" event={"ID":"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997","Type":"ContainerDied","Data":"101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560"}
Jul 24 15:19:52.647363 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.647256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc" event={"ID":"a6a7afe4-83af-46e3-bf0f-ad8f66a4c997","Type":"ContainerDied","Data":"a0fe5d23d260a304488a0d4788366df8038e5d11c1f26a8b9553531905e3985a"}
Jul 24 15:19:52.647363 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.647286    2580 scope.go:117] "RemoveContainer" containerID="101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560"
Jul 24 15:19:52.648867 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.648845    2580 generic.go:356] "Generic (PLEG): container finished" podID="37c18472-f92a-4488-8e8c-463f228730f6" containerID="4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22" exitCode=0
Jul 24 15:19:52.649001 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.648890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4" event={"ID":"37c18472-f92a-4488-8e8c-463f228730f6","Type":"ContainerDied","Data":"4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22"}
Jul 24 15:19:52.649001 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.648911    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"
Jul 24 15:19:52.649001 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.648957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4" event={"ID":"37c18472-f92a-4488-8e8c-463f228730f6","Type":"ContainerDied","Data":"152101ea97303efbba33510bd9d7a3bff56ef93cd6bf10f336db541d160a122e"}
Jul 24 15:19:52.650468 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.650417    2580 generic.go:356] "Generic (PLEG): container finished" podID="41f78b44-0382-4bd6-93fa-d7e90978a1d3" containerID="c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72" exitCode=0
Jul 24 15:19:52.650723 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.650472    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"
Jul 24 15:19:52.650723 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.650547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" event={"ID":"41f78b44-0382-4bd6-93fa-d7e90978a1d3","Type":"ContainerDied","Data":"c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72"}
Jul 24 15:19:52.650723 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.650605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj" event={"ID":"41f78b44-0382-4bd6-93fa-d7e90978a1d3","Type":"ContainerDied","Data":"b030577639b16624e44c80a918c22b18cddd6d5f31583b03d05af95c5156d937"}
Jul 24 15:19:52.659589 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.659566    2580 scope.go:117] "RemoveContainer" containerID="101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560"
Jul 24 15:19:52.660014 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:19:52.659983    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560\": container with ID starting with 101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560 not found: ID does not exist" containerID="101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560"
Jul 24 15:19:52.660122 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.660026    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560"} err="failed to get container status \"101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560\": rpc error: code = NotFound desc = could not find container \"101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560\": container with ID starting with 101b3aeda0c570973cba5af15f83291803fc5706c8897648108d0b726bcde560 not found: ID does not exist"
Jul 24 15:19:52.660122 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.660056    2580 scope.go:117] "RemoveContainer" containerID="4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22"
Jul 24 15:19:52.669106 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.669089    2580 scope.go:117] "RemoveContainer" containerID="4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22"
Jul 24 15:19:52.669368 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:19:52.669346    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22\": container with ID starting with 4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22 not found: ID does not exist" containerID="4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22"
Jul 24 15:19:52.669416 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.669375    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22"} err="failed to get container status \"4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22\": rpc error: code = NotFound desc = could not find container \"4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22\": container with ID starting with 4fd2ebd19669a5c2b6b62daa350866d36b61424d5314b8351123111fc63c2b22 not found: ID does not exist"
Jul 24 15:19:52.669416 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.669392    2580 scope.go:117] "RemoveContainer" containerID="c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72"
Jul 24 15:19:52.677784 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.677750    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"]
Jul 24 15:19:52.678671 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.678632    2580 scope.go:117] "RemoveContainer" containerID="c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72"
Jul 24 15:19:52.678947 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:19:52.678929    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72\": container with ID starting with c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72 not found: ID does not exist" containerID="c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72"
Jul 24 15:19:52.679029 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.678953    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72"} err="failed to get container status \"c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72\": rpc error: code = NotFound desc = could not find container \"c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72\": container with ID starting with c3d526bb9f7f3d9205d5f6818b52ddea647726ac891117aa10ea6d900d6f6a72 not found: ID does not exist"
Jul 24 15:19:52.680591 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.680569    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2edd1c-6c876677cd-r7bhc"]
Jul 24 15:19:52.698843 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.698778    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"]
Jul 24 15:19:52.702238 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.702211    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2edd1c-5b8fd45b6b-qmzhj"]
Jul 24 15:19:52.714128 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.714100    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"]
Jul 24 15:19:52.720095 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:52.720071    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2edd1c-565666c95b-2p5v4"]
Jul 24 15:19:53.065064 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:53.065028    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37c18472-f92a-4488-8e8c-463f228730f6" path="/var/lib/kubelet/pods/37c18472-f92a-4488-8e8c-463f228730f6/volumes"
Jul 24 15:19:53.065509 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:53.065492    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f78b44-0382-4bd6-93fa-d7e90978a1d3" path="/var/lib/kubelet/pods/41f78b44-0382-4bd6-93fa-d7e90978a1d3/volumes"
Jul 24 15:19:53.065857 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:19:53.065844    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" path="/var/lib/kubelet/pods/a6a7afe4-83af-46e3-bf0f-ad8f66a4c997/volumes"
Jul 24 15:20:24.498659 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.498623    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"]
Jul 24 15:20:24.499227 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.498871    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" podUID="4e1bdc34-4f22-4a32-a72a-763a592705b5" containerName="maas-api" containerID="cri-o://716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b" gracePeriod=30
Jul 24 15:20:24.559806 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.559755    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"]
Jul 24 15:20:24.560012 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.559987    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq" podUID="4144f585-70ae-441b-b0c8-89138623f56a" containerName="payload-pre-processing" containerID="cri-o://c557d9c32b52bb6f14a78fc670bf64927ec34dbbd699d2261449866bb8f6000f" gracePeriod=30
Jul 24 15:20:24.810615 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.810585    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:20:24.831805 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.831333    2580 generic.go:356] "Generic (PLEG): container finished" podID="4e1bdc34-4f22-4a32-a72a-763a592705b5" containerID="716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b" exitCode=0
Jul 24 15:20:24.831805 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.831424    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"
Jul 24 15:20:24.831805 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.831501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" event={"ID":"4e1bdc34-4f22-4a32-a72a-763a592705b5","Type":"ContainerDied","Data":"716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b"}
Jul 24 15:20:24.831805 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.831581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft" event={"ID":"4e1bdc34-4f22-4a32-a72a-763a592705b5","Type":"ContainerDied","Data":"328a6ed5d03891cc7af571cc0af147610e936af9cca79d1b9ae5fa7765bab379"}
Jul 24 15:20:24.831805 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.831614    2580 scope.go:117] "RemoveContainer" containerID="716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b"
Jul 24 15:20:24.835247 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.835159    2580 generic.go:356] "Generic (PLEG): container finished" podID="4144f585-70ae-441b-b0c8-89138623f56a" containerID="c557d9c32b52bb6f14a78fc670bf64927ec34dbbd699d2261449866bb8f6000f" exitCode=0
Jul 24 15:20:24.835247 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.835192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq" event={"ID":"4144f585-70ae-441b-b0c8-89138623f56a","Type":"ContainerDied","Data":"c557d9c32b52bb6f14a78fc670bf64927ec34dbbd699d2261449866bb8f6000f"}
Jul 24 15:20:24.844503 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.844476    2580 scope.go:117] "RemoveContainer" containerID="716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b"
Jul 24 15:20:24.844760 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:20:24.844742    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b\": container with ID starting with 716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b not found: ID does not exist" containerID="716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b"
Jul 24 15:20:24.844874 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.844768    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b"} err="failed to get container status \"716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b\": rpc error: code = NotFound desc = could not find container \"716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b\": container with ID starting with 716802e6373b242623c71fc9f499f9dee5f795ef766a1141d4becea6a5db666b not found: ID does not exist"
Jul 24 15:20:24.846885 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.846862    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:20:24.854252 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.854230    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t58gf\" (UniqueName: \"kubernetes.io/projected/4e1bdc34-4f22-4a32-a72a-763a592705b5-kube-api-access-t58gf\") pod \"4e1bdc34-4f22-4a32-a72a-763a592705b5\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") "
Jul 24 15:20:24.854358 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.854278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1bdc34-4f22-4a32-a72a-763a592705b5-openshift-service-ca\") pod \"4e1bdc34-4f22-4a32-a72a-763a592705b5\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") "
Jul 24 15:20:24.854358 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.854352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls\") pod \"4e1bdc34-4f22-4a32-a72a-763a592705b5\" (UID: \"4e1bdc34-4f22-4a32-a72a-763a592705b5\") "
Jul 24 15:20:24.854665 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.854642    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1bdc34-4f22-4a32-a72a-763a592705b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4e1bdc34-4f22-4a32-a72a-763a592705b5" (UID: "4e1bdc34-4f22-4a32-a72a-763a592705b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:20:24.856397 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.856367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4e1bdc34-4f22-4a32-a72a-763a592705b5" (UID: "4e1bdc34-4f22-4a32-a72a-763a592705b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:20:24.856473 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.856371    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1bdc34-4f22-4a32-a72a-763a592705b5-kube-api-access-t58gf" (OuterVolumeSpecName: "kube-api-access-t58gf") pod "4e1bdc34-4f22-4a32-a72a-763a592705b5" (UID: "4e1bdc34-4f22-4a32-a72a-763a592705b5"). InnerVolumeSpecName "kube-api-access-t58gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:20:24.955222 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.955188    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4144f585-70ae-441b-b0c8-89138623f56a-plugins-config-volume\") pod \"4144f585-70ae-441b-b0c8-89138623f56a\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") "
Jul 24 15:20:24.955380 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.955276    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhfql\" (UniqueName: \"kubernetes.io/projected/4144f585-70ae-441b-b0c8-89138623f56a-kube-api-access-qhfql\") pod \"4144f585-70ae-441b-b0c8-89138623f56a\" (UID: \"4144f585-70ae-441b-b0c8-89138623f56a\") "
Jul 24 15:20:24.955467 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.955452    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t58gf\" (UniqueName: \"kubernetes.io/projected/4e1bdc34-4f22-4a32-a72a-763a592705b5-kube-api-access-t58gf\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:20:24.955467 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.955463    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1bdc34-4f22-4a32-a72a-763a592705b5-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:20:24.955578 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.955472    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e1bdc34-4f22-4a32-a72a-763a592705b5-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:20:24.955648 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.955568    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4144f585-70ae-441b-b0c8-89138623f56a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4144f585-70ae-441b-b0c8-89138623f56a" (UID: "4144f585-70ae-441b-b0c8-89138623f56a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:20:24.957521 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:24.957496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4144f585-70ae-441b-b0c8-89138623f56a-kube-api-access-qhfql" (OuterVolumeSpecName: "kube-api-access-qhfql") pod "4144f585-70ae-441b-b0c8-89138623f56a" (UID: "4144f585-70ae-441b-b0c8-89138623f56a"). InnerVolumeSpecName "kube-api-access-qhfql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:20:25.056430 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.056349    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4144f585-70ae-441b-b0c8-89138623f56a-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:20:25.056430 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.056374    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhfql\" (UniqueName: \"kubernetes.io/projected/4144f585-70ae-441b-b0c8-89138623f56a-kube-api-access-qhfql\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:20:25.149733 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.149705    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"]
Jul 24 15:20:25.152044 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.152019    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bb95eb-754cdc69cf-2cdft"]
Jul 24 15:20:25.841566 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.841487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"
Jul 24 15:20:25.841566 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.841525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq" event={"ID":"4144f585-70ae-441b-b0c8-89138623f56a","Type":"ContainerDied","Data":"cc26bb490741ef907633c4abf3a4ac872610b964b86b2a777600280da0c8364c"}
Jul 24 15:20:25.842102 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.841590    2580 scope.go:117] "RemoveContainer" containerID="c557d9c32b52bb6f14a78fc670bf64927ec34dbbd699d2261449866bb8f6000f"
Jul 24 15:20:25.858421 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.858392    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"]
Jul 24 15:20:25.860529 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:25.860509    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bb95eb-576ff779b-dg7mq"]
Jul 24 15:20:27.065086 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:27.065052    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4144f585-70ae-441b-b0c8-89138623f56a" path="/var/lib/kubelet/pods/4144f585-70ae-441b-b0c8-89138623f56a/volumes"
Jul 24 15:20:27.065495 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:20:27.065430    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1bdc34-4f22-4a32-a72a-763a592705b5" path="/var/lib/kubelet/pods/4e1bdc34-4f22-4a32-a72a-763a592705b5/volumes"
Jul 24 15:21:37.744435 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:37.744396    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"]
Jul 24 15:21:37.745123 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:37.744627    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" podUID="f03900e9-3b87-4c80-989b-ca53e7d8dda7" containerName="maas-api" containerID="cri-o://13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5" gracePeriod=30
Jul 24 15:21:38.000833 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.000730    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:21:38.032084 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.032055    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03900e9-3b87-4c80-989b-ca53e7d8dda7-openshift-service-ca\") pod \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") "
Jul 24 15:21:38.032274 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.032092    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhr9n\" (UniqueName: \"kubernetes.io/projected/f03900e9-3b87-4c80-989b-ca53e7d8dda7-kube-api-access-lhr9n\") pod \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") "
Jul 24 15:21:38.032274 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.032164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls\") pod \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\" (UID: \"f03900e9-3b87-4c80-989b-ca53e7d8dda7\") "
Jul 24 15:21:38.032482 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.032459    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03900e9-3b87-4c80-989b-ca53e7d8dda7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f03900e9-3b87-4c80-989b-ca53e7d8dda7" (UID: "f03900e9-3b87-4c80-989b-ca53e7d8dda7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:21:38.034225 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.034201    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f03900e9-3b87-4c80-989b-ca53e7d8dda7" (UID: "f03900e9-3b87-4c80-989b-ca53e7d8dda7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:21:38.034346 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.034262    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03900e9-3b87-4c80-989b-ca53e7d8dda7-kube-api-access-lhr9n" (OuterVolumeSpecName: "kube-api-access-lhr9n") pod "f03900e9-3b87-4c80-989b-ca53e7d8dda7" (UID: "f03900e9-3b87-4c80-989b-ca53e7d8dda7"). InnerVolumeSpecName "kube-api-access-lhr9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:21:38.133345 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.133314    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03900e9-3b87-4c80-989b-ca53e7d8dda7-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:21:38.133345 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.133340    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhr9n\" (UniqueName: \"kubernetes.io/projected/f03900e9-3b87-4c80-989b-ca53e7d8dda7-kube-api-access-lhr9n\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:21:38.133345 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.133352    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03900e9-3b87-4c80-989b-ca53e7d8dda7-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:21:38.227802 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.227755    2580 generic.go:356] "Generic (PLEG): container finished" podID="f03900e9-3b87-4c80-989b-ca53e7d8dda7" containerID="13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5" exitCode=0
Jul 24 15:21:38.228007 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.227834    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"
Jul 24 15:21:38.228007 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.227858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" event={"ID":"f03900e9-3b87-4c80-989b-ca53e7d8dda7","Type":"ContainerDied","Data":"13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5"}
Jul 24 15:21:38.228007 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.227923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh" event={"ID":"f03900e9-3b87-4c80-989b-ca53e7d8dda7","Type":"ContainerDied","Data":"abf40bfc504400d95fd6862a3823f24852f92b63cb8900515f4c71ad618b0acb"}
Jul 24 15:21:38.228007 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.227953    2580 scope.go:117] "RemoveContainer" containerID="13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5"
Jul 24 15:21:38.237528 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.237511    2580 scope.go:117] "RemoveContainer" containerID="13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5"
Jul 24 15:21:38.237833 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:21:38.237785    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5\": container with ID starting with 13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5 not found: ID does not exist" containerID="13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5"
Jul 24 15:21:38.237931 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.237839    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5"} err="failed to get container status \"13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5\": rpc error: code = NotFound desc = could not find container \"13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5\": container with ID starting with 13b4ef529dc65e40e22f6ba2e0566304234d451dc9db50b594973924d29b74f5 not found: ID does not exist"
Jul 24 15:21:38.250450 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.250425    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"]
Jul 24 15:21:38.255280 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:38.255222    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ba0783-58f75646d4-mnfgh"]
Jul 24 15:21:39.065320 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:39.065290    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03900e9-3b87-4c80-989b-ca53e7d8dda7" path="/var/lib/kubelet/pods/f03900e9-3b87-4c80-989b-ca53e7d8dda7/volumes"
Jul 24 15:21:58.708010 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:58.707974    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"]
Jul 24 15:21:58.708416 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:58.708203    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" podUID="e48bc583-53cd-42d9-9ea3-55b795a8d86b" containerName="maas-api" containerID="cri-o://7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e" gracePeriod=30
Jul 24 15:21:58.969024 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:58.968956    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:21:59.035205 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.035175    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls\") pod \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") "
Jul 24 15:21:59.035205 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.035206    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r8qj\" (UniqueName: \"kubernetes.io/projected/e48bc583-53cd-42d9-9ea3-55b795a8d86b-kube-api-access-9r8qj\") pod \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") "
Jul 24 15:21:59.035419 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.035289    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48bc583-53cd-42d9-9ea3-55b795a8d86b-openshift-service-ca\") pod \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\" (UID: \"e48bc583-53cd-42d9-9ea3-55b795a8d86b\") "
Jul 24 15:21:59.035673 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.035641    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e48bc583-53cd-42d9-9ea3-55b795a8d86b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e48bc583-53cd-42d9-9ea3-55b795a8d86b" (UID: "e48bc583-53cd-42d9-9ea3-55b795a8d86b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:21:59.037308 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.037285    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e48bc583-53cd-42d9-9ea3-55b795a8d86b" (UID: "e48bc583-53cd-42d9-9ea3-55b795a8d86b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:21:59.037398 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.037331    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48bc583-53cd-42d9-9ea3-55b795a8d86b-kube-api-access-9r8qj" (OuterVolumeSpecName: "kube-api-access-9r8qj") pod "e48bc583-53cd-42d9-9ea3-55b795a8d86b" (UID: "e48bc583-53cd-42d9-9ea3-55b795a8d86b"). InnerVolumeSpecName "kube-api-access-9r8qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:21:59.136853 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.136821    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48bc583-53cd-42d9-9ea3-55b795a8d86b-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:21:59.136853 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.136853    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r8qj\" (UniqueName: \"kubernetes.io/projected/e48bc583-53cd-42d9-9ea3-55b795a8d86b-kube-api-access-9r8qj\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:21:59.137046 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.136869    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48bc583-53cd-42d9-9ea3-55b795a8d86b-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:21:59.340264 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.340177    2580 generic.go:356] "Generic (PLEG): container finished" podID="e48bc583-53cd-42d9-9ea3-55b795a8d86b" containerID="7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e" exitCode=0
Jul 24 15:21:59.340264 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.340218    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"
Jul 24 15:21:59.340441 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.340264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" event={"ID":"e48bc583-53cd-42d9-9ea3-55b795a8d86b","Type":"ContainerDied","Data":"7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e"}
Jul 24 15:21:59.340441 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.340318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn" event={"ID":"e48bc583-53cd-42d9-9ea3-55b795a8d86b","Type":"ContainerDied","Data":"ba2072123fb5241640b352e1638d68f6c4e15df202a482b33a4be0ab051483ca"}
Jul 24 15:21:59.340441 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.340341    2580 scope.go:117] "RemoveContainer" containerID="7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e"
Jul 24 15:21:59.349590 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.349566    2580 scope.go:117] "RemoveContainer" containerID="7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e"
Jul 24 15:21:59.349906 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:21:59.349884    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e\": container with ID starting with 7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e not found: ID does not exist" containerID="7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e"
Jul 24 15:21:59.349992 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.349913    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e"} err="failed to get container status \"7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e\": rpc error: code = NotFound desc = could not find container \"7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e\": container with ID starting with 7d71bd366da2c11dca266f1e8f20760cdca88545d95994f7844f2179509c9b8e not found: ID does not exist"
Jul 24 15:21:59.357084 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.357058    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"]
Jul 24 15:21:59.362342 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:21:59.362319    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc7d81-75dc9cf877-zxlkn"]
Jul 24 15:22:01.065145 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:01.065114    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e48bc583-53cd-42d9-9ea3-55b795a8d86b" path="/var/lib/kubelet/pods/e48bc583-53cd-42d9-9ea3-55b795a8d86b/volumes"
Jul 24 15:22:20.941100 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:20.941060    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"]
Jul 24 15:22:20.941698 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:20.941427    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" podUID="92835b54-9c8e-47e9-ad5e-61623513eaf0" containerName="maas-api" containerID="cri-o://91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b" gracePeriod=30
Jul 24 15:22:21.010217 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.010174    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"]
Jul 24 15:22:21.010497 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.010442    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv" podUID="78884742-4fdb-4917-88d5-c4094288a0b4" containerName="payload-processing" containerID="cri-o://70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa" gracePeriod=30
Jul 24 15:22:21.016345 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.016316    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"]
Jul 24 15:22:21.016633 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.016577    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr" podUID="b7281fdc-0367-4b6f-8700-1c75d0017aa6" containerName="payload-pre-processing" containerID="cri-o://c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775" gracePeriod=30
Jul 24 15:22:21.288824 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.288772    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:22:21.300086 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.300065    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:22:21.317178 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.317154    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:22:21.341969 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.341939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7281fdc-0367-4b6f-8700-1c75d0017aa6-plugins-config-volume\") pod \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") "
Jul 24 15:22:21.341969 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.341972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv88l\" (UniqueName: \"kubernetes.io/projected/b7281fdc-0367-4b6f-8700-1c75d0017aa6-kube-api-access-qv88l\") pod \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\" (UID: \"b7281fdc-0367-4b6f-8700-1c75d0017aa6\") "
Jul 24 15:22:21.342227 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.342018    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmv8p\" (UniqueName: \"kubernetes.io/projected/92835b54-9c8e-47e9-ad5e-61623513eaf0-kube-api-access-wmv8p\") pod \"92835b54-9c8e-47e9-ad5e-61623513eaf0\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") "
Jul 24 15:22:21.342227 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.342039    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78884742-4fdb-4917-88d5-c4094288a0b4-plugins-config-volume\") pod \"78884742-4fdb-4917-88d5-c4094288a0b4\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") "
Jul 24 15:22:21.342415 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.342383    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7281fdc-0367-4b6f-8700-1c75d0017aa6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7281fdc-0367-4b6f-8700-1c75d0017aa6" (UID: "b7281fdc-0367-4b6f-8700-1c75d0017aa6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:22:21.342852 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.342783    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78884742-4fdb-4917-88d5-c4094288a0b4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "78884742-4fdb-4917-88d5-c4094288a0b4" (UID: "78884742-4fdb-4917-88d5-c4094288a0b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:22:21.343144 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.343013    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l59tj\" (UniqueName: \"kubernetes.io/projected/78884742-4fdb-4917-88d5-c4094288a0b4-kube-api-access-l59tj\") pod \"78884742-4fdb-4917-88d5-c4094288a0b4\" (UID: \"78884742-4fdb-4917-88d5-c4094288a0b4\") "
Jul 24 15:22:21.343144 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.343076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92835b54-9c8e-47e9-ad5e-61623513eaf0-openshift-service-ca\") pod \"92835b54-9c8e-47e9-ad5e-61623513eaf0\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") "
Jul 24 15:22:21.343834 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.343519    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls\") pod \"92835b54-9c8e-47e9-ad5e-61623513eaf0\" (UID: \"92835b54-9c8e-47e9-ad5e-61623513eaf0\") "
Jul 24 15:22:21.343834 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.343534    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92835b54-9c8e-47e9-ad5e-61623513eaf0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "92835b54-9c8e-47e9-ad5e-61623513eaf0" (UID: "92835b54-9c8e-47e9-ad5e-61623513eaf0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:22:21.344235 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.344211    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7281fdc-0367-4b6f-8700-1c75d0017aa6-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.344323 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.344242    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78884742-4fdb-4917-88d5-c4094288a0b4-plugins-config-volume\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.344323 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.344257    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92835b54-9c8e-47e9-ad5e-61623513eaf0-openshift-service-ca\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.344703 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.344675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7281fdc-0367-4b6f-8700-1c75d0017aa6-kube-api-access-qv88l" (OuterVolumeSpecName: "kube-api-access-qv88l") pod "b7281fdc-0367-4b6f-8700-1c75d0017aa6" (UID: "b7281fdc-0367-4b6f-8700-1c75d0017aa6"). InnerVolumeSpecName "kube-api-access-qv88l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:22:21.345156 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.345128    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92835b54-9c8e-47e9-ad5e-61623513eaf0-kube-api-access-wmv8p" (OuterVolumeSpecName: "kube-api-access-wmv8p") pod "92835b54-9c8e-47e9-ad5e-61623513eaf0" (UID: "92835b54-9c8e-47e9-ad5e-61623513eaf0"). InnerVolumeSpecName "kube-api-access-wmv8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:22:21.345533 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.345505    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78884742-4fdb-4917-88d5-c4094288a0b4-kube-api-access-l59tj" (OuterVolumeSpecName: "kube-api-access-l59tj") pod "78884742-4fdb-4917-88d5-c4094288a0b4" (UID: "78884742-4fdb-4917-88d5-c4094288a0b4"). InnerVolumeSpecName "kube-api-access-l59tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:22:21.346156 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.346137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "92835b54-9c8e-47e9-ad5e-61623513eaf0" (UID: "92835b54-9c8e-47e9-ad5e-61623513eaf0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:22:21.445353 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.445323    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92835b54-9c8e-47e9-ad5e-61623513eaf0-maas-api-tls\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.445353 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.445351    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv88l\" (UniqueName: \"kubernetes.io/projected/b7281fdc-0367-4b6f-8700-1c75d0017aa6-kube-api-access-qv88l\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.445353 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.445360    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmv8p\" (UniqueName: \"kubernetes.io/projected/92835b54-9c8e-47e9-ad5e-61623513eaf0-kube-api-access-wmv8p\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.445594 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.445372    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l59tj\" (UniqueName: \"kubernetes.io/projected/78884742-4fdb-4917-88d5-c4094288a0b4-kube-api-access-l59tj\") on node \"ip-10-0-140-168.ec2.internal\" DevicePath \"\""
Jul 24 15:22:21.462112 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.462012    2580 generic.go:356] "Generic (PLEG): container finished" podID="b7281fdc-0367-4b6f-8700-1c75d0017aa6" containerID="c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775" exitCode=0
Jul 24 15:22:21.462112 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.462058    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"
Jul 24 15:22:21.462312 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.462105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr" event={"ID":"b7281fdc-0367-4b6f-8700-1c75d0017aa6","Type":"ContainerDied","Data":"c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775"}
Jul 24 15:22:21.462312 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.462155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr" event={"ID":"b7281fdc-0367-4b6f-8700-1c75d0017aa6","Type":"ContainerDied","Data":"4c334f41eed11dac3ec41b8d25fe8017002b80fb785c7f236b1db51d87777af8"}
Jul 24 15:22:21.462312 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.462172    2580 scope.go:117] "RemoveContainer" containerID="c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775"
Jul 24 15:22:21.463425 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.463405    2580 generic.go:356] "Generic (PLEG): container finished" podID="78884742-4fdb-4917-88d5-c4094288a0b4" containerID="70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa" exitCode=0
Jul 24 15:22:21.463531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.463446    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"
Jul 24 15:22:21.463531 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.463497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv" event={"ID":"78884742-4fdb-4917-88d5-c4094288a0b4","Type":"ContainerDied","Data":"70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa"}
Jul 24 15:22:21.463641 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.463545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv" event={"ID":"78884742-4fdb-4917-88d5-c4094288a0b4","Type":"ContainerDied","Data":"c788c7b17d7106193c08e5d32dbceb3bd602fcbe5aea4fe3180451b090936333"}
Jul 24 15:22:21.465115 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.465089    2580 generic.go:356] "Generic (PLEG): container finished" podID="92835b54-9c8e-47e9-ad5e-61623513eaf0" containerID="91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b" exitCode=0
Jul 24 15:22:21.465261 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.465114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" event={"ID":"92835b54-9c8e-47e9-ad5e-61623513eaf0","Type":"ContainerDied","Data":"91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b"}
Jul 24 15:22:21.465261 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.465131    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"
Jul 24 15:22:21.465261 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.465173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk" event={"ID":"92835b54-9c8e-47e9-ad5e-61623513eaf0","Type":"ContainerDied","Data":"d5b115f4143fe503c29f210702e6e0a91fdc9e99333bee394978d514d116663f"}
Jul 24 15:22:21.472255 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.472217    2580 scope.go:117] "RemoveContainer" containerID="c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775"
Jul 24 15:22:21.472568 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:22:21.472542    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775\": container with ID starting with c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775 not found: ID does not exist" containerID="c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775"
Jul 24 15:22:21.472641 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.472582    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775"} err="failed to get container status \"c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775\": rpc error: code = NotFound desc = could not find container \"c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775\": container with ID starting with c32a8bc4b2744ad02aaa2163a3a600ee59b3b24e39cb3f1c8a85d945b88aa775 not found: ID does not exist"
Jul 24 15:22:21.472641 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.472606    2580 scope.go:117] "RemoveContainer" containerID="70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa"
Jul 24 15:22:21.481472 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.481450    2580 scope.go:117] "RemoveContainer" containerID="70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa"
Jul 24 15:22:21.481761 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:22:21.481738    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa\": container with ID starting with 70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa not found: ID does not exist" containerID="70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa"
Jul 24 15:22:21.481841 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.481769    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa"} err="failed to get container status \"70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa\": rpc error: code = NotFound desc = could not find container \"70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa\": container with ID starting with 70e76ee30c6530dec6d909cffd45c226b4d63c4aa6857416a7bac72bee4996aa not found: ID does not exist"
Jul 24 15:22:21.481841 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.481801    2580 scope.go:117] "RemoveContainer" containerID="91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b"
Jul 24 15:22:21.490543 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.490524    2580 scope.go:117] "RemoveContainer" containerID="91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b"
Jul 24 15:22:21.490873 ip-10-0-140-168 kubenswrapper[2580]: E0724 15:22:21.490850    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b\": container with ID starting with 91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b not found: ID does not exist" containerID="91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b"
Jul 24 15:22:21.490929 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.490881    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b"} err="failed to get container status \"91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b\": rpc error: code = NotFound desc = could not find container \"91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b\": container with ID starting with 91d73339df13445b2a0502661894c39235a7da58e3eddac90298b8924d8ee63b not found: ID does not exist"
Jul 24 15:22:21.491402 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.491384    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"]
Jul 24 15:22:21.495082 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.495056    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8ea489-645bd6c888-vmzqr"]
Jul 24 15:22:21.505131 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.505093    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"]
Jul 24 15:22:21.508266 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.508246    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8ea489-748f78ddc4-zzpwv"]
Jul 24 15:22:21.519260 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.519234    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"]
Jul 24 15:22:21.523175 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:21.523153    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ea489-7fb8c6d958-hbnrk"]
Jul 24 15:22:23.065360 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:23.065321    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78884742-4fdb-4917-88d5-c4094288a0b4" path="/var/lib/kubelet/pods/78884742-4fdb-4917-88d5-c4094288a0b4/volumes"
Jul 24 15:22:23.065828 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:23.065781    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92835b54-9c8e-47e9-ad5e-61623513eaf0" path="/var/lib/kubelet/pods/92835b54-9c8e-47e9-ad5e-61623513eaf0/volumes"
Jul 24 15:22:23.066265 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:23.066245    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7281fdc-0367-4b6f-8700-1c75d0017aa6" path="/var/lib/kubelet/pods/b7281fdc-0367-4b6f-8700-1c75d0017aa6/volumes"
Jul 24 15:22:38.357556 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:38.357481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cc6cf846f-kxtk4_f9044750-7d05-444d-a409-5009fda86f2c/manager/0.log"
Jul 24 15:22:38.821828 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:38.821785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-45rs4_aad0b899-7def-4d5d-9b83-18451d52719b/copy-manifests/0.log"
Jul 24 15:22:38.841331 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:38.841302    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-45rs4_aad0b899-7def-4d5d-9b83-18451d52719b/manager/0.log"
Jul 24 15:22:39.306689 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:39.306662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5858c6db48-5v5nk_4c2bbaca-4050-4cd2-af32-5f4238315ba8/maas-api/0.log"
Jul 24 15:22:39.752584 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:39.752551    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6pq2z_964f1f60-6dab-44df-af36-e3212ee0d0aa/postgres/0.log"
Jul 24 15:22:40.534441 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.534402    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw_9d9188c1-af15-4a55-9b09-1f7824f34497/util/0.log"
Jul 24 15:22:40.541604 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.541576    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw_9d9188c1-af15-4a55-9b09-1f7824f34497/pull/0.log"
Jul 24 15:22:40.548548 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.548529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw_9d9188c1-af15-4a55-9b09-1f7824f34497/extract/0.log"
Jul 24 15:22:40.665607 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.665574    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd_c4f5d040-a3cd-4022-96aa-ce7465423dec/util/0.log"
Jul 24 15:22:40.672502 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.672467    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd_c4f5d040-a3cd-4022-96aa-ce7465423dec/pull/0.log"
Jul 24 15:22:40.679281 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.679256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd_c4f5d040-a3cd-4022-96aa-ce7465423dec/extract/0.log"
Jul 24 15:22:40.800400 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.800322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg_00d464ce-ff4b-4f2a-acd9-9c133a5efa08/util/0.log"
Jul 24 15:22:40.806780 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.806754    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg_00d464ce-ff4b-4f2a-acd9-9c133a5efa08/pull/0.log"
Jul 24 15:22:40.813468 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.813448    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg_00d464ce-ff4b-4f2a-acd9-9c133a5efa08/extract/0.log"
Jul 24 15:22:40.924876 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.924844    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb_25f9fc7b-86d5-497f-b69f-64fabc1225b8/util/0.log"
Jul 24 15:22:40.931511 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.931488    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb_25f9fc7b-86d5-497f-b69f-64fabc1225b8/pull/0.log"
Jul 24 15:22:40.937858 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:40.937834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb_25f9fc7b-86d5-497f-b69f-64fabc1225b8/extract/0.log"
Jul 24 15:22:42.336917 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:42.336885    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mfkrm_1fedbf58-2d97-49ad-aab5-8adad8b84e9c/discovery/0.log"
Jul 24 15:22:42.811272 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:42.811237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8wjsn_bfed338d-7103-4826-9ff3-95be30c465a4/payload-pre-processing/0.log"
Jul 24 15:22:43.677976 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:43.677951    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8hfxl_350deba7-2ac6-47e8-bbbf-c0a4da32c7da/main/0.log"
Jul 24 15:22:43.802594 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:43.802560    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxmrb2_e73d47cd-7ed9-4c7c-915f-21ea896d8866/main/0.log"
Jul 24 15:22:43.918666 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:43.918641    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-m77hv_9f17d856-a902-4049-9bba-d4dc07b197f6/main/0.log"
Jul 24 15:22:52.434262 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:52.434232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xt4ch_05ffa7a9-abf2-43ac-b9ee-499a0a5d095e/global-pull-secret-syncer/0.log"
Jul 24 15:22:52.574999 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:52.574968    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rcx6v_88a17919-0477-477c-b0d5-f67cdeebf42d/konnectivity-agent/0.log"
Jul 24 15:22:52.603523 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:52.603493    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-168.ec2.internal_cda8959942da19ca79401d79b37cc59f/haproxy/0.log"
Jul 24 15:22:56.181102 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.181015    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw_9d9188c1-af15-4a55-9b09-1f7824f34497/extract/0.log"
Jul 24 15:22:56.204318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.204291    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw_9d9188c1-af15-4a55-9b09-1f7824f34497/util/0.log"
Jul 24 15:22:56.231686 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.231654    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qqfzw_9d9188c1-af15-4a55-9b09-1f7824f34497/pull/0.log"
Jul 24 15:22:56.257556 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.257525    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd_c4f5d040-a3cd-4022-96aa-ce7465423dec/extract/0.log"
Jul 24 15:22:56.278738 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.278707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd_c4f5d040-a3cd-4022-96aa-ce7465423dec/util/0.log"
Jul 24 15:22:56.310407 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.310384    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j7rxd_c4f5d040-a3cd-4022-96aa-ce7465423dec/pull/0.log"
Jul 24 15:22:56.381385 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.381358    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg_00d464ce-ff4b-4f2a-acd9-9c133a5efa08/extract/0.log"
Jul 24 15:22:56.430212 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.430183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg_00d464ce-ff4b-4f2a-acd9-9c133a5efa08/util/0.log"
Jul 24 15:22:56.504116 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.504033    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lqpkg_00d464ce-ff4b-4f2a-acd9-9c133a5efa08/pull/0.log"
Jul 24 15:22:56.536894 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.536860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb_25f9fc7b-86d5-497f-b69f-64fabc1225b8/extract/0.log"
Jul 24 15:22:56.561925 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.561899    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb_25f9fc7b-86d5-497f-b69f-64fabc1225b8/util/0.log"
Jul 24 15:22:56.584740 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:56.584713    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cldb_25f9fc7b-86d5-497f-b69f-64fabc1225b8/pull/0.log"
Jul 24 15:22:59.331694 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.331654    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5n8fr_27d95595-36ac-40a3-ac84-9ffbb8b30c91/kube-state-metrics/0.log"
Jul 24 15:22:59.350838 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.350808    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5n8fr_27d95595-36ac-40a3-ac84-9ffbb8b30c91/kube-rbac-proxy-main/0.log"
Jul 24 15:22:59.373287 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.373243    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5n8fr_27d95595-36ac-40a3-ac84-9ffbb8b30c91/kube-rbac-proxy-self/0.log"
Jul 24 15:22:59.410845 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.410815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7446c74b59-vxbp5_1861b07b-42c0-44ca-9629-0dadd81ac0b2/metrics-server/0.log"
Jul 24 15:22:59.484446 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.484409    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvr4k_c060a4b3-be4b-4938-982b-c864dea5c418/node-exporter/0.log"
Jul 24 15:22:59.504897 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.504859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvr4k_c060a4b3-be4b-4938-982b-c864dea5c418/kube-rbac-proxy/0.log"
Jul 24 15:22:59.526097 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.526071    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvr4k_c060a4b3-be4b-4938-982b-c864dea5c418/init-textfile/0.log"
Jul 24 15:22:59.727926 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.727895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-66dhd_f44df95a-2748-4ffb-a526-569b34a58f9f/kube-rbac-proxy-main/0.log"
Jul 24 15:22:59.751563 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.751526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-66dhd_f44df95a-2748-4ffb-a526-569b34a58f9f/kube-rbac-proxy-self/0.log"
Jul 24 15:22:59.785807 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:22:59.785761    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-66dhd_f44df95a-2748-4ffb-a526-569b34a58f9f/openshift-state-metrics/0.log"
Jul 24 15:23:02.982726 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.982632    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"]
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983244    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7281fdc-0367-4b6f-8700-1c75d0017aa6" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983265    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7281fdc-0367-4b6f-8700-1c75d0017aa6" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983275    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48bc583-53cd-42d9-9ea3-55b795a8d86b" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983281    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48bc583-53cd-42d9-9ea3-55b795a8d86b" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983291    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" containerName="payload-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983300    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" containerName="payload-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983311    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f78b44-0382-4bd6-93fa-d7e90978a1d3" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983317    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f78b44-0382-4bd6-93fa-d7e90978a1d3" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983324    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4144f585-70ae-441b-b0c8-89138623f56a" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983329    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4144f585-70ae-441b-b0c8-89138623f56a" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983338    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c18472-f92a-4488-8e8c-463f228730f6" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983343    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c18472-f92a-4488-8e8c-463f228730f6" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983354    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78884742-4fdb-4917-88d5-c4094288a0b4" containerName="payload-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983359    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="78884742-4fdb-4917-88d5-c4094288a0b4" containerName="payload-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983365    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03900e9-3b87-4c80-989b-ca53e7d8dda7" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983371    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03900e9-3b87-4c80-989b-ca53e7d8dda7" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983385    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92835b54-9c8e-47e9-ad5e-61623513eaf0" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983392    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="92835b54-9c8e-47e9-ad5e-61623513eaf0" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983399    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1bdc34-4f22-4a32-a72a-763a592705b5" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983404    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1bdc34-4f22-4a32-a72a-763a592705b5" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983469    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4144f585-70ae-441b-b0c8-89138623f56a" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983476    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03900e9-3b87-4c80-989b-ca53e7d8dda7" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983483    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f78b44-0382-4bd6-93fa-d7e90978a1d3" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983488    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="92835b54-9c8e-47e9-ad5e-61623513eaf0" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983493    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48bc583-53cd-42d9-9ea3-55b795a8d86b" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983498    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7281fdc-0367-4b6f-8700-1c75d0017aa6" containerName="payload-pre-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983504    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a7afe4-83af-46e3-bf0f-ad8f66a4c997" containerName="payload-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983512    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="78884742-4fdb-4917-88d5-c4094288a0b4" containerName="payload-processing"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983516    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1bdc34-4f22-4a32-a72a-763a592705b5" containerName="maas-api"
Jul 24 15:23:02.983623 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.983521    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c18472-f92a-4488-8e8c-463f228730f6" containerName="payload-pre-processing"
Jul 24 15:23:02.986553 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.986538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:02.989894 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.989877    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84bxh\"/\"kube-root-ca.crt\""
Jul 24 15:23:02.990892 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.990874    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-84bxh\"/\"default-dockercfg-48m4q\""
Jul 24 15:23:02.990892 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.990885    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84bxh\"/\"openshift-service-ca.crt\""
Jul 24 15:23:02.995758 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:02.995737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"]
Jul 24 15:23:03.009534 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.009508    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d97676cc5-4jd9s_b4278a54-163d-46be-accf-c5eeefebbda6/console/0.log"
Jul 24 15:23:03.020381 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.020349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-proc\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.020569 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.020386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zdz\" (UniqueName: \"kubernetes.io/projected/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-kube-api-access-x7zdz\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.020569 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.020409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-lib-modules\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.020569 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.020504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-sys\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.020569 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.020535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-podres\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.055295 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.055262    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-d6jwc_7e28f646-85c6-4d7c-b441-33feb45ce286/download-server/0.log"
Jul 24 15:23:03.121057 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-proc\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121057 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zdz\" (UniqueName: \"kubernetes.io/projected/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-kube-api-access-x7zdz\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-lib-modules\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-proc\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-lib-modules\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-sys\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-podres\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121318 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-sys\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.121698 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.121357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-podres\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.129946 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.129920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zdz\" (UniqueName: \"kubernetes.io/projected/1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea-kube-api-access-x7zdz\") pod \"perf-node-gather-daemonset-4szpm\" (UID: \"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.297740 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.297638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.452387 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.452268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"]
Jul 24 15:23:03.454562 ip-10-0-140-168 kubenswrapper[2580]: W0724 15:23:03.454529    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c9ce6fb_68ec_4cbf_af23_c6ccd9732aea.slice/crio-235ebb75d47049e972951962e0c2575479c196f7363c2636b9922cd21c292529 WatchSource:0}: Error finding container 235ebb75d47049e972951962e0c2575479c196f7363c2636b9922cd21c292529: Status 404 returned error can't find the container with id 235ebb75d47049e972951962e0c2575479c196f7363c2636b9922cd21c292529
Jul 24 15:23:03.687076 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.687042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm" event={"ID":"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea","Type":"ContainerStarted","Data":"38924d7e6789bb9d04b0b3bd1353faed785c8eea0a08c6f929856983fb9bfb06"}
Jul 24 15:23:03.687255 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.687092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm" event={"ID":"1c9ce6fb-68ec-4cbf-af23-c6ccd9732aea","Type":"ContainerStarted","Data":"235ebb75d47049e972951962e0c2575479c196f7363c2636b9922cd21c292529"}
Jul 24 15:23:03.687255 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.687180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:03.706331 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:03.706281    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm" podStartSLOduration=1.706262915 podStartE2EDuration="1.706262915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:23:03.704702742 +0000 UTC m=+3061.056547928" watchObservedRunningTime="2026-07-24 15:23:03.706262915 +0000 UTC m=+3061.058108099"
Jul 24 15:23:05.009648 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:05.009620    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r54nl_d73b1034-66bf-4881-a3f4-b89ba2f3c5ee/dns/0.log"
Jul 24 15:23:05.030513 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:05.030492    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r54nl_d73b1034-66bf-4881-a3f4-b89ba2f3c5ee/kube-rbac-proxy/0.log"
Jul 24 15:23:05.100145 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:05.100119    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p98nd_4edef46f-1fc9-4f63-af71-1b0fcec2ca6f/dns-node-resolver/0.log"
Jul 24 15:23:05.638175 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:05.638139    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c69cb9868-64k4h_cdb68225-2a5c-472c-8c21-89f07a1422b0/registry/0.log"
Jul 24 15:23:05.663560 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:05.663533    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7kpn_082dbcf0-d2ee-4854-a7a0-6ca0df0b06c8/node-ca/0.log"
Jul 24 15:23:06.932439 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:06.932408    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mfkrm_1fedbf58-2d97-49ad-aab5-8adad8b84e9c/discovery/0.log"
Jul 24 15:23:07.077703 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:07.077670    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8wjsn_bfed338d-7103-4826-9ff3-95be30c465a4/payload-pre-processing/0.log"
Jul 24 15:23:07.998708 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:07.998676    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wrlfw_d18571c9-c1df-447d-98ac-cb7f303e5201/serve-healthcheck-canary/0.log"
Jul 24 15:23:08.769649 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:08.769613    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxg4z_f6742722-db63-4f27-bbc6-1f9597e55c99/kube-rbac-proxy/0.log"
Jul 24 15:23:08.793513 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:08.793481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxg4z_f6742722-db63-4f27-bbc6-1f9597e55c99/exporter/0.log"
Jul 24 15:23:08.817138 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:08.817092    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxg4z_f6742722-db63-4f27-bbc6-1f9597e55c99/extractor/0.log"
Jul 24 15:23:09.701740 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:09.701714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-4szpm"
Jul 24 15:23:11.739023 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:11.738994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cc6cf846f-kxtk4_f9044750-7d05-444d-a409-5009fda86f2c/manager/0.log"
Jul 24 15:23:12.038139 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:12.038111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-45rs4_aad0b899-7def-4d5d-9b83-18451d52719b/manager/0.log"
Jul 24 15:23:12.054182 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:12.054155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-45rs4_aad0b899-7def-4d5d-9b83-18451d52719b/copy-manifests/0.log"
Jul 24 15:23:13.444412 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:13.444377    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55664b4b95-tpvtb_17daa7da-e5d0-4758-aa33-c1e258422350/manager/0.log"
Jul 24 15:23:13.493359 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:13.493309    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7sq7p_7a61096f-46bd-4dba-ad73-5c9a986ab7a2/openshift-lws-operator/0.log"
Jul 24 15:23:13.927433 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:13.927399    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mfkrm_1fedbf58-2d97-49ad-aab5-8adad8b84e9c/discovery/0.log"
Jul 24 15:23:14.029559 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:14.029519    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8wjsn_bfed338d-7103-4826-9ff3-95be30c465a4/payload-pre-processing/0.log"
Jul 24 15:23:15.761228 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:15.761187    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mfkrm_1fedbf58-2d97-49ad-aab5-8adad8b84e9c/discovery/0.log"
Jul 24 15:23:15.878535 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:15.878501    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8wjsn_bfed338d-7103-4826-9ff3-95be30c465a4/payload-pre-processing/0.log"
Jul 24 15:23:20.116329 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.116297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/kube-multus-additional-cni-plugins/0.log"
Jul 24 15:23:20.140578 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.140553    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/egress-router-binary-copy/0.log"
Jul 24 15:23:20.163784 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.163762    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/cni-plugins/0.log"
Jul 24 15:23:20.186748 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.186725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/bond-cni-plugin/0.log"
Jul 24 15:23:20.209342 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.209318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/routeoverride-cni/0.log"
Jul 24 15:23:20.230293 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.230271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/whereabouts-cni-bincopy/0.log"
Jul 24 15:23:20.251365 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.251340    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvtlt_6cd1b0dc-4f66-42c7-b20c-e23d1eb0834f/whereabouts-cni/0.log"
Jul 24 15:23:20.513560 ip-10-0-140-168 kubenswrapper[2580]: I0724 15:23:20.513532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s66br_d97cd8c6-9e80-4841-87f8-f82fcbcb266a/kube-multus/0.log"