Jul 15 13:04:18.652259 ip-10-0-143-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 13:04:18.652270 ip-10-0-143-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 13:04:18.652281 ip-10-0-143-224 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 13:04:18.652587 ip-10-0-143-224 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 13:04:28.732068 ip-10-0-143-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 13:04:28.732090 ip-10-0-143-224 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b820eb96d2c047a396a8de43291691c2 --
Jul 15 13:06:29.132432 ip-10-0-143-224 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 13:06:29.524423 ip-10-0-143-224 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:06:29.524423 ip-10-0-143-224 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 13:06:29.524423 ip-10-0-143-224 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:06:29.524423 ip-10-0-143-224 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 13:06:29.525053 ip-10-0-143-224 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:06:29.527204 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.527072    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 13:06:29.531839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531819    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:06:29.531839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531839    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:06:29.531839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531843    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531846    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531849    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531853    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531856    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531864    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531868    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531872    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531875    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531878    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531881    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531883    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531886    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531889    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531892    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531894    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531897    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531900    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531903    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531905    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:06:29.531935 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531908    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531912    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531916    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531919    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531923    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531925    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531928    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531931    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531934    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531937    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531940    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531942    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531946    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531948    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531951    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531954    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531958    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531960    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531963    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:06:29.532453 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531966    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531968    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531971    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531973    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531976    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531978    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531981    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531983    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531985    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531988    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531990    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531993    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531995    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.531998    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532001    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532004    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532007    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532009    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532012    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532014    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:06:29.532908 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532017    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532020    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532022    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532025    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532028    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532030    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532032    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532035    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532037    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532040    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532043    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532045    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532048    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532050    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532053    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532055    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532058    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532060    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532063    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532065    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:06:29.533396 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532068    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532070    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532073    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532075    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532078    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532082    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532085    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532087    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532090    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532106    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532109    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532113    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532116    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532121    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532124    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532127    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532130    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532133    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532855    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532862    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:06:29.533857 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532865    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532867    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532870    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532873    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532875    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532879    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532883    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532887    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532890    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532893    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532895    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532898    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532900    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532903    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532906    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532908    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532912    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532917    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532920    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:06:29.534325 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532924    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532927    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532929    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532932    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532934    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532937    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532940    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532943    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532945    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532948    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532950    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532953    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532955    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532958    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532960    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532963    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532965    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532968    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532972    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532975    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:06:29.534815 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532979    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532982    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532984    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532987    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532989    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532992    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532994    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532997    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.532999    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533002    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533005    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533008    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533010    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533013    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533016    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533018    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533021    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533024    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533027    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:06:29.535305 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533030    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533033    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533036    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533039    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533041    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533044    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533046    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533049    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533051    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533054    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533056    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533059    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533061    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533064    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533067    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533069    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533074    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533077    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533079    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:06:29.535762 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533082    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533084    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533087    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533089    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533106    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533109    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533112    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533115    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533117    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533120    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533122    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533125    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533129    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533131    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533134    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533136    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533139    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533141    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533144    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533146    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:06:29.536223 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533531    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533537    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533540    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533542    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533545    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533548    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533551    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533554    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533556    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533559    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533561    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533564    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533567    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533569    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533572    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533574    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533577    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533580    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533582    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533585    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:06:29.536701 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533588    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533590    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533593    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533596    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533599    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533601    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533604    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533606    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533609    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533611    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533614    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533617    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533619    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533622    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533624    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533626    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533629    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533632    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533634    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533637    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:06:29.537198 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533640    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533642    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533645    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533647    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533650    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533652    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533655    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533658    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533661    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533664    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533667    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533670    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533672    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533675    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533679    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533683    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533686    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533689    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533692    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:06:29.537673 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533694    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533697    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533701    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533704    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533708    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533710    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533713    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533716    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533718    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533721    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533724    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533727    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533729    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533740    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533743    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533747    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533749    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533752    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533754    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533757    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:06:29.538241 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533763    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533766    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533769    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533772    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533774    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533777    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533780    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533782    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533785    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533787    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533790    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533793    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533795    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533798    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533800    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533803    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533805    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533809    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533812    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:06:29.539032 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.533815    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533890    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533898    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533904    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533909    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533913    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533916    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533921    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533926    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533929    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533932    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533936    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533940    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533944    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533949    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533952    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533955    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533958    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533961    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533965    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533968    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533971    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533975    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533978    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 13:06:29.539777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533982    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533985    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533988    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533992    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533995    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.533998    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534000    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534003    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534006    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534010    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534013    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534016    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534019    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534022    2561 flags.go:64] FLAG: --enable-server="true"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534025    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534029    2561 flags.go:64] FLAG: --event-burst="100"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534033    2561 flags.go:64] FLAG: --event-qps="50"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534036    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534039    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534042    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534046    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534050    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534054    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534057    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534060    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 13:06:29.540729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534063    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534066    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534069    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534072    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534075    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534078    2561 flags.go:64] FLAG: --feature-gates=""
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534082    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534085    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534088    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534091    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534108    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534112    2561 flags.go:64] FLAG: --help="false"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534115    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534118    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534121    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534124    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534127    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534130    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534133    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534136    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534139    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534142    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534145    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534148    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 13:06:29.541438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534152    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534155    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534158    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534161    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534165    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534170    2561 flags.go:64] FLAG: --lock-file=""
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534174    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534177    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534180    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534186    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534188    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534192    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534194    2561 flags.go:64] FLAG: --logging-format="text"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534197    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534201    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534204    2561 flags.go:64] FLAG: --manifest-url=""
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534206    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534211    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534214    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534218    2561 flags.go:64] FLAG: --max-pods="110"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534221    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534224    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534227    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534230    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534233    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 13:06:29.542185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534236    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534239    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534246    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534249    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534252    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534255    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534258    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534263    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534267    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534270    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534273    2561 flags.go:64] FLAG: --port="10250"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534277    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534280    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a97fce23670f9b61"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534285    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534288    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534291    2561 flags.go:64] FLAG: --register-node="true"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534294    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534302    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534305    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534308    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534311    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534315    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534318    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534321    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534324    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 13:06:29.543120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534327    2561 flags.go:64] FLAG: --runonce="false"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534330    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534333    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534336    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534339    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534342    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534345    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534348    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534351    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534354    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534357    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534360    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534362    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534366    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534369    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534372    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534735    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534739    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534744    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534747    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534751    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534753    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534756    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534759    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534762    2561 flags.go:64] FLAG: --v="2"
Jul 15 13:06:29.543727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534766    2561 flags.go:64] FLAG: --version="false"
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534770    2561 flags.go:64] FLAG: --vmodule=""
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534774    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.534777    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534888    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534892    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534895    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534898    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534901    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534904    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534907    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534909    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534911    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534914    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534916    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534919    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534921    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534924    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534926    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534929    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:06:29.544345 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534931    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534933    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534936    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534938    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534941    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534945    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534947    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534950    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534953    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534955    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534958    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534960    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534963    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534965    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534968    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534970    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534974    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534976    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534978    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534981    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:06:29.544839 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534983    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534986    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534989    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534991    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534994    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534996    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.534999    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535001    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535003    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535006    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535008    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535011    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535013    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535015    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535018    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535020    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535023    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535026    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535028    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535031    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:06:29.545378 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535034    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535036    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535039    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535041    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535044    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535046    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535048    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535051    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535054    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535058    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535061    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535063    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535066    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535068    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535071    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535073    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535077    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535081    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535084    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:06:29.545860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535086    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535089    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535092    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535107    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535110    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535113    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535115    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535118    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535121    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535123    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535126    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535131    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535134    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535137    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535140    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535142    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535145    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535147    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535150    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535152    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:06:29.546335 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535154    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535157    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535159    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.535163    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.535169    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.543745    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.543764    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.545124    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.545137    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545200    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545205    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545209    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545212    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545217    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:06:29.546809 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545221    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545224    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545228    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545231    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545234    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545237    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545240    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545243    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545246    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545248    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545251    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545254    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545256    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545259    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545263    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545266    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545269    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545271    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545274    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:06:29.547180 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545277    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545279    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545282    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545285    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545289    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545293    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545296    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545298    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545301    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545304    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545306    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545309    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545312    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545314    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545317    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545319    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545322    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545324    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545327    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545330    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:06:29.547629 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545332    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545335    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545339    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545341    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545344    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545346    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545349    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545351    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545354    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545356    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545359    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545362    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545364    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545367    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545369    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545373    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545375    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545379    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545381    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545384    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:06:29.548125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545387    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545390    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545393    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545396    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545399    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545402    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545404    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545407    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545409    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545412    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545415    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545417    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545420    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545422    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545425    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545429    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545432    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545434    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545437    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545439    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:06:29.548622 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545442    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545444    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545447    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545450    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545452    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545455    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545457    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545460    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545463    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545466    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545470    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545474    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545477    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545481    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:06:29.549112 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545483    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.545489    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545611    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545617    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545621    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545624    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545626    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545630    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545634    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545637    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545640    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545643    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545646    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545648    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545652    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:06:29.549547 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545654    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545657    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545660    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545662    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545665    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545668    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545671    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545674    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545676    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545678    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545681    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545683    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545686    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545689    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545691    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545694    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545697    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545699    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545702    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545705    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:06:29.549903 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545707    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545710    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545712    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545715    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545717    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545721    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545725    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545728    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545732    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545734    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545737    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545740    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545743    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545745    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545748    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545751    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545753    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545756    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545759    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:06:29.550390 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545763    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545766    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545769    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545772    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545775    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545778    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545781    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545784    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545787    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545790    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545792    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545795    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545798    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545800    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545803    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545805    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545808    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545810    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545813    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545815    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:06:29.550840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545818    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545820    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545823    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545825    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545828    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545830    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545834    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545836    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545839    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545842    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545845    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545848    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545850    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545853    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545856    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545858    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545861    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545864    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545867    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:06:29.551472 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545869    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545872    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545875    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545877    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545879    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545882    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545885    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:29.545887    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.545892    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.546017    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.549187    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.550665    2561 server.go:1019] "Starting client certificate rotation"
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.550768    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 13:06:29.551924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.550808    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 13:06:29.552874 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.552859    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 13:06:29.555696 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.555676    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 13:06:29.565598 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.565577    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 15 13:06:29.567564 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.567549    2561 log.go:25] "Validated CRI v1 image API"
Jul 15 13:06:29.568355 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.568341    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 13:06:29.571298 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.571268    2561 fs.go:135] Filesystem UUIDs: map[1e87347e-5c3b-4587-9292-f20014352946:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f9fcd3a5-bbef-493a-843a-061f4d5a0763:/dev/nvme0n1p3]
Jul 15 13:06:29.571382 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.571296    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 13:06:29.576968 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.576815    2561 manager.go:216] Machine: {Timestamp:2026-07-15 13:06:29.575657387 +0000 UTC m=+0.321852149 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101100 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2037275279dc5cb7fd72328d599d81 SystemUUID:ec203727-5279-dc5c-b7fd-72328d599d81 BootID:b820eb96-d2c0-47a3-96a8-de43291691c2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:48:ce:74:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:48:ce:74:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:49:0a:b9:67:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 13:06:29.576968 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.576955    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 13:06:29.577174 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.577068    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 13:06:29.579919 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.579895    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 13:06:29.580561 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.579929    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 13:06:29.581325 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.581023    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 13:06:29.581325 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.581047    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 13:06:29.581325 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.581059    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 13:06:29.581785 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.581761    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 13:06:29.582110 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.581613    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 13:06:29.583688 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.583674    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 13:06:29.586230 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586219    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 13:06:29.586348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586339    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 13:06:29.586386 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586368    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 13:06:29.586386 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586378    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 13:06:29.586459 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586392    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 13:06:29.586459 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586402    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 15 13:06:29.586459 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586410    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 13:06:29.586794 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586782    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 13:06:29.586833 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.586804    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 13:06:29.589302 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.589279    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 13:06:29.590997 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.590980    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 13:06:29.591067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591028    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 13:06:29.591256 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591246    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 13:06:29.591288 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591262    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 13:06:29.591288 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591269    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 13:06:29.591288 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591276    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 13:06:29.591372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591289    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 13:06:29.591372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591296    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 13:06:29.591762 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591753    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 13:06:29.591762 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591762    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 13:06:29.591825 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591769    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 13:06:29.591825 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591775    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 13:06:29.591825 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591784    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 13:06:29.591825 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.591791    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 13:06:29.592723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.592712    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 13:06:29.592723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.592723    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 13:06:29.595936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.595914    2561 server.go:1268] "Started kubelet"
Jul 15 13:06:29.596031 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.596008    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 13:06:29.596085 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.595993    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 13:06:29.596169 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.596123    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 13:06:29.596751 ip-10-0-143-224 systemd[1]: Started Kubernetes Kubelet.
Jul 15 13:06:29.597429 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.597413    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 13:06:29.597660 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.597585    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 13:06:29.600165 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.600145    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 13:06:29.600165 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.600146    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 13:06:29.600344 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.600195    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 13:06:29.603334 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.603303    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 13:06:29.603454 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.603437    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 13:06:29.603454 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.603444    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 13:06:29.603593 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.603539    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:29.604184 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.604161    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 13:06:29.604305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.604202    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 13:06:29.604305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.604216    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 13:06:29.604305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.604299    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 13:06:29.604305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.604307    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 13:06:29.605010 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.604992    2561 factory.go:55] Registering systemd factory
Jul 15 13:06:29.605072 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605014    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 15 13:06:29.605240 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605228    2561 factory.go:153] Registering CRI-O factory
Jul 15 13:06:29.605295 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605244    2561 factory.go:223] Registration of the crio container factory successfully
Jul 15 13:06:29.605329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605314    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 13:06:29.605364 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605335    2561 factory.go:103] Registering Raw factory
Jul 15 13:06:29.605364 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605349    2561 manager.go:1196] Started watching for new ooms in manager
Jul 15 13:06:29.605860 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.605838    2561 manager.go:349] Starting recovery of all containers
Jul 15 13:06:29.612434 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.612403    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 13:06:29.612526 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.612507    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 13:06:29.613805 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.610918    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-224.ec2.internal.18c27867cc4090e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-224.ec2.internal,UID:ip-10-0-143-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-224.ec2.internal,},FirstTimestamp:2026-07-15 13:06:29.595885801 +0000 UTC m=+0.342080563,LastTimestamp:2026-07-15 13:06:29.595885801 +0000 UTC m=+0.342080563,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-224.ec2.internal,}"
Jul 15 13:06:29.616698 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.616680    2561 manager.go:354] Recovery completed
Jul 15 13:06:29.621471 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.621359    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.623308 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623289    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.623355 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623329    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.623355 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623344    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.623912 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623899    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 13:06:29.623912 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623912    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 13:06:29.623984 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623917    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.623984 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.623929    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 13:06:29.624365 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.624350    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jv877"
Jul 15 13:06:29.624663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.624648    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.624734 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.624678    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.624734 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.624688    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.625359 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.625333    2561 policy_none.go:49] "None policy: Start"
Jul 15 13:06:29.625406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.625370    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 13:06:29.625406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.625383    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 13:06:29.625460 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.625301    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-224.ec2.internal.18c27867cde3058b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-224.ec2.internal,UID:ip-10-0-143-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-224.ec2.internal,},FirstTimestamp:2026-07-15 13:06:29.623309707 +0000 UTC m=+0.369504480,LastTimestamp:2026-07-15 13:06:29.623309707 +0000 UTC m=+0.369504480,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-224.ec2.internal,}"
Jul 15 13:06:29.626508 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.626497    2561 policy_none.go:47] "Start"
Jul 15 13:06:29.634708 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.634628    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-224.ec2.internal.18c27867cde36b82  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-224.ec2.internal,UID:ip-10-0-143-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-224.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-224.ec2.internal,},FirstTimestamp:2026-07-15 13:06:29.62333581 +0000 UTC m=+0.369530571,LastTimestamp:2026-07-15 13:06:29.62333581 +0000 UTC m=+0.369530571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-224.ec2.internal,}"
Jul 15 13:06:29.635417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.635400    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jv877"
Jul 15 13:06:29.659921 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.659902    2561 manager.go:337] "Starting Device Plugin manager"
Jul 15 13:06:29.660048 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.659941    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 13:06:29.660048 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.659956    2561 server.go:87] "Starting device plugin registration server"
Jul 15 13:06:29.660304 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.660291    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 13:06:29.660354 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.660308    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 13:06:29.660448 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.660419    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 13:06:29.660537 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.660507    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 13:06:29.660537 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.660516    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 13:06:29.661045 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.661022    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 13:06:29.661134 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.661081    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:29.760574 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.760532    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.761855 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.761513    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.761855 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.761544    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.761855 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.761555    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.761855 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.761583    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.770199 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.770179    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.770264 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.770204    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-224.ec2.internal\": node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:29.780204 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.780133    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 13:06:29.781393 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.781376    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 13:06:29.781508 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.781410    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 13:06:29.781508 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.781432    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 13:06:29.781508 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.781467    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 13:06:29.784474 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.784449    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:06:29.793084 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.793066    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:29.882329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.882287    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"]
Jul 15 13:06:29.882430 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.882381    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.884077 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.884055    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.884181 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.884088    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.884181 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.884118    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.885331 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.885318    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.885466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.885450    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.885517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.885486    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.886140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.886125    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.886140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.886134    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.886246 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.886152    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.886246 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.886156    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.886246 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.886166    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.886246 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.886166    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.887811 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.887794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.887866 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.887836    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:06:29.888580 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.888560    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:06:29.888672 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.888594    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:06:29.888672 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.888608    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:06:29.893601 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.893586    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:29.907106 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.907079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf6b0844b00827ab6eeff6cc6879a70c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-224.ec2.internal\" (UID: \"bf6b0844b00827ab6eeff6cc6879a70c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.907176 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.907144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1c96d8911d62c1c0e4352675d5a0883-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"b1c96d8911d62c1c0e4352675d5a0883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.907216 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:29.907179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c96d8911d62c1c0e4352675d5a0883-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"b1c96d8911d62c1c0e4352675d5a0883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.913935 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.913917    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-224.ec2.internal\" not found" node="ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.918476 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.918461    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-224.ec2.internal\" not found" node="ip-10-0-143-224.ec2.internal"
Jul 15 13:06:29.994527 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:29.994494    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.008121 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.008085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf6b0844b00827ab6eeff6cc6879a70c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-224.ec2.internal\" (UID: \"bf6b0844b00827ab6eeff6cc6879a70c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.008221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.008130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1c96d8911d62c1c0e4352675d5a0883-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"b1c96d8911d62c1c0e4352675d5a0883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.008221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.008147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c96d8911d62c1c0e4352675d5a0883-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"b1c96d8911d62c1c0e4352675d5a0883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.008221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.008176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf6b0844b00827ab6eeff6cc6879a70c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-224.ec2.internal\" (UID: \"bf6b0844b00827ab6eeff6cc6879a70c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.008221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.008193    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c96d8911d62c1c0e4352675d5a0883-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"b1c96d8911d62c1c0e4352675d5a0883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.008221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.008203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1c96d8911d62c1c0e4352675d5a0883-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"b1c96d8911d62c1c0e4352675d5a0883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.095217 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:30.095139    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.195647 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:30.195612    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.216165 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.216141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.220810 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.220792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.296236 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:30.296189    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.396782 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:30.396698    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.480573 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.480542    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:06:30.497712 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:30.497683    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.550264 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.550234    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 13:06:30.550755 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.550404    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 13:06:30.550755 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.550435    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 13:06:30.598673 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:30.598641    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Jul 15 13:06:30.628654 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.628626    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:06:30.637915 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.637879    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:01:31 +0000 UTC" deadline="2028-04-18 08:20:34.87840405 +0000 UTC"
Jul 15 13:06:30.637915 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.637910    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15427h14m4.240496894s"
Jul 15 13:06:30.657212 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:30.657178    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c96d8911d62c1c0e4352675d5a0883.slice/crio-c51ffff4cb4d6bce1f3b78f7ac32305691bb3378b3e9322de4e45128a07738bb WatchSource:0}: Error finding container c51ffff4cb4d6bce1f3b78f7ac32305691bb3378b3e9322de4e45128a07738bb: Status 404 returned error can't find the container with id c51ffff4cb4d6bce1f3b78f7ac32305691bb3378b3e9322de4e45128a07738bb
Jul 15 13:06:30.657487 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:30.657475    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6b0844b00827ab6eeff6cc6879a70c.slice/crio-01bb063d01054209e9abb501fa2840cfe5af35ce0b8917a4027aa82b0796515a WatchSource:0}: Error finding container 01bb063d01054209e9abb501fa2840cfe5af35ce0b8917a4027aa82b0796515a: Status 404 returned error can't find the container with id 01bb063d01054209e9abb501fa2840cfe5af35ce0b8917a4027aa82b0796515a
Jul 15 13:06:30.661589 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.661574    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:06:30.704568 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.704541    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.716157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.716134    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 13:06:30.717108 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.717083    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Jul 15 13:06:30.724141 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.724128    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 13:06:30.784592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.784548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" event={"ID":"b1c96d8911d62c1c0e4352675d5a0883","Type":"ContainerStarted","Data":"c51ffff4cb4d6bce1f3b78f7ac32305691bb3378b3e9322de4e45128a07738bb"}
Jul 15 13:06:30.785576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:30.785556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal" event={"ID":"bf6b0844b00827ab6eeff6cc6879a70c","Type":"ContainerStarted","Data":"01bb063d01054209e9abb501fa2840cfe5af35ce0b8917a4027aa82b0796515a"}
Jul 15 13:06:32.963370 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:32.963339    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:06:33.384782 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.384743    2561 apiserver.go:52] "Watching apiserver"
Jul 15 13:06:33.393325 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.393296    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 13:06:33.393763 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.393735    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qdwr2","openshift-image-registry/node-ca-ggpgm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal","openshift-network-diagnostics/network-check-target-99bsw","openshift-ovn-kubernetes/ovnkube-node-cdmmc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s","openshift-dns/node-resolver-r8567","openshift-multus/multus-additional-cni-plugins-dnh2g","openshift-multus/multus-mnmrf","openshift-multus/network-metrics-daemon-2fj7r","openshift-network-operator/iptables-alerter-6k7qx","kube-system/global-pull-secret-syncer-rqjmp","kube-system/konnectivity-agent-lqb5j","kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"]
Jul 15 13:06:33.395529 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.395505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.396628 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.396605    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.398249 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.398226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.400135 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.400116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:33.400233 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.400182    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:33.400668 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.400640    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 13:06:33.400668 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.400657    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 13:06:33.400909 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.400795    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.400988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.400911    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.400988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.400936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nm2tj\""
Jul 15 13:06:33.401095 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401076    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 13:06:33.401162 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401104    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.401162 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401149    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-45nvz\""
Jul 15 13:06:33.401313 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401267    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 13:06:33.401664 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.401870 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401847    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.401959 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.401913    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 13:06:33.402120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.402099    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8dvgg\""
Jul 15 13:06:33.402225 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.402182    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 13:06:33.403462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.403102    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.404104 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.404063    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 13:06:33.404104 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.404083    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.405934 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.405007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.405934 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.405097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f2z2q\""
Jul 15 13:06:33.405934 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.405412    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 13:06:33.405934 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.405413    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 13:06:33.407789 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.407574    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 13:06:33.407789 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.407695    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 13:06:33.407789 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.407730    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.408663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.408017    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 13:06:33.408663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.408145    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.408663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.408158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.408663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.408238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s8bqx\""
Jul 15 13:06:33.408911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.408718    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.409926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.409909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.411305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.411268    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.411739 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.411499    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.411739 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.411535    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8j92l\""
Jul 15 13:06:33.411739 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.411535    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k77dx\""
Jul 15 13:06:33.411922 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.411752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:33.411922 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.411829    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:33.412399 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.412379    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.412882 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.412842    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qst2t\""
Jul 15 13:06:33.412882 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.412877    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 13:06:33.412999 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.412955    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.413806 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.413788    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.414260 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414238    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 13:06:33.414534 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52a78dd4-98bf-4c8b-b4cb-50e16b079019-agent-certs\") pod \"konnectivity-agent-lqb5j\" (UID: \"52a78dd4-98bf-4c8b-b4cb-50e16b079019\") " pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.414600 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52a78dd4-98bf-4c8b-b4cb-50e16b079019-konnectivity-ca\") pod \"konnectivity-agent-lqb5j\" (UID: \"52a78dd4-98bf-4c8b-b4cb-50e16b079019\") " pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.414658 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-system-cni-dir\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.414658 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-os-release\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.414658 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-kubelet\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-slash\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-log-socket\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26ww9\" (UniqueName: \"kubernetes.io/projected/6c4dd699-0297-458a-bc7a-1f9d38048e55-kube-api-access-26ww9\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-etc-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-cni-bin\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovn-node-metrics-cert\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.414936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krz5k\" (UniqueName: \"kubernetes.io/projected/29d473db-3c07-45ba-b602-7af6780e7e88-kube-api-access-krz5k\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5v5\" (UniqueName: \"kubernetes.io/projected/f88d2deb-323b-4573-8132-689d02eb00e8-kube-api-access-hb5v5\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.414987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovnkube-script-lib\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d473db-3c07-45ba-b602-7af6780e7e88-tmp-dir\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29d473db-3c07-45ba-b602-7af6780e7e88-hosts-file\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:33.415145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-cni-netd\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-systemd\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-node-log\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.415218    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-cnibin\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-run-netns\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-ovn\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovnkube-config\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-env-overrides\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-systemd-units\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.415511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.415455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-var-lib-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.416214 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.416193    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:06:33.416371 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.416352    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bdv4c\""
Jul 15 13:06:33.416430 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.416417    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 13:06:33.417048 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.417029    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 13:06:33.439086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.439048    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4988"
Jul 15 13:06:33.448051 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.448030    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4988"
Jul 15 13:06:33.502849 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.502814    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 13:06:33.516040 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29d473db-3c07-45ba-b602-7af6780e7e88-hosts-file\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.516194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.516194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:33.516194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-etc-kubernetes\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.516194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29d473db-3c07-45ba-b602-7af6780e7e88-hosts-file\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.516352 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-node-log\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.516398 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.516440 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-netns\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.516501 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c08f3d1c-a2d6-4668-91bd-7072d254a978-host\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.516501 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-node-log\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.516501 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:33.516632 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.516632 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-cnibin\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.516632 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.516755 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-cnibin\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.516755 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-ovn\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.516851 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.516851 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516806    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-ovn\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.516851 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-cnibin\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.516851 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx599\" (UniqueName: \"kubernetes.io/projected/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-kube-api-access-nx599\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.517039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-run\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-sys\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-kubelet\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.517039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.516983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-systemd-units\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-registration-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.517039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-cni-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-systemd-units\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-modprobe-d\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-kubernetes\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7r2j\" (UniqueName: \"kubernetes.io/projected/c08f3d1c-a2d6-4668-91bd-7072d254a978-kube-api-access-b7r2j\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7psv\" (UniqueName: \"kubernetes.io/projected/2f2a7bf0-07c3-454e-a8f8-018379221c64-kube-api-access-p7psv\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52a78dd4-98bf-4c8b-b4cb-50e16b079019-agent-certs\") pod \"konnectivity-agent-lqb5j\" (UID: \"52a78dd4-98bf-4c8b-b4cb-50e16b079019\") " pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-log-socket\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26ww9\" (UniqueName: \"kubernetes.io/projected/6c4dd699-0297-458a-bc7a-1f9d38048e55-kube-api-access-26ww9\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517348    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d60dd821-7191-45cd-93cb-54131193f903-etc-tuned\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-log-socket\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-etc-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-etc-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-cni-bin\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-hostroot\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517596    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysconfig\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-cni-bin\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d60dd821-7191-45cd-93cb-54131193f903-tmp\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krz5k\" (UniqueName: \"kubernetes.io/projected/29d473db-3c07-45ba-b602-7af6780e7e88-kube-api-access-krz5k\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovnkube-script-lib\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-multus-certs\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-lib-modules\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.517926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-var-lib-kubelet\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.517986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-host\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f2a7bf0-07c3-454e-a8f8-018379221c64-iptables-alerter-script\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c08f3d1c-a2d6-4668-91bd-7072d254a978-serviceca\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aea8d8b2-fea6-4098-ba33-99a22b7022a4-kubelet-config\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-cni-netd\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-cni-netd\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-sys-fs\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlld\" (UniqueName: \"kubernetes.io/projected/d60dd821-7191-45cd-93cb-54131193f903-kube-api-access-xwlld\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-systemd\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-device-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-system-cni-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-socket-dir-parent\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-run-netns\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovnkube-script-lib\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovnkube-config\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.518639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-run-netns\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-env-overrides\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-k8s-cni-cncf-io\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-cni-multus\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-run-systemd\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.518985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-var-lib-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-var-lib-openvswitch\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5g9\" (UniqueName: \"kubernetes.io/projected/f02e7e8e-7628-4291-bcc6-203da9da2216-kube-api-access-8l5g9\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52a78dd4-98bf-4c8b-b4cb-50e16b079019-konnectivity-ca\") pod \"konnectivity-agent-lqb5j\" (UID: \"52a78dd4-98bf-4c8b-b4cb-50e16b079019\") " pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f88d2deb-323b-4573-8132-689d02eb00e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-system-cni-dir\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-system-cni-dir\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovnkube-config\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-os-release\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519247    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-os-release\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.519458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c4dd699-0297-458a-bc7a-1f9d38048e55-env-overrides\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-kubelet\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-slash\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-kubelet\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-cni-binary-copy\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-cni-bin\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aea8d8b2-fea6-4098-ba33-99a22b7022a4-dbus\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-slash\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovn-node-metrics-cert\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-socket-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c4dd699-0297-458a-bc7a-1f9d38048e55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-os-release\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-conf-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-daemon-config\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f2a7bf0-07c3-454e-a8f8-018379221c64-host-slash\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.520235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5v5\" (UniqueName: \"kubernetes.io/projected/f88d2deb-323b-4573-8132-689d02eb00e8-kube-api-access-hb5v5\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwcs\" (UniqueName: \"kubernetes.io/projected/f661cd77-7517-40dc-a6ac-797f159a995b-kube-api-access-2rwcs\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.519979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-systemd\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.520001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d473db-3c07-45ba-b602-7af6780e7e88-tmp-dir\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.520035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysctl-d\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.520065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysctl-conf\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.520405    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52a78dd4-98bf-4c8b-b4cb-50e16b079019-konnectivity-ca\") pod \"konnectivity-agent-lqb5j\" (UID: \"52a78dd4-98bf-4c8b-b4cb-50e16b079019\") " pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.520468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f88d2deb-323b-4573-8132-689d02eb00e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.521063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.520499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d473db-3c07-45ba-b602-7af6780e7e88-tmp-dir\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.522646 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.522558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c4dd699-0297-458a-bc7a-1f9d38048e55-ovn-node-metrics-cert\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.523004 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.522925    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52a78dd4-98bf-4c8b-b4cb-50e16b079019-agent-certs\") pod \"konnectivity-agent-lqb5j\" (UID: \"52a78dd4-98bf-4c8b-b4cb-50e16b079019\") " pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.525267 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.524687    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:06:33.525267 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.524716    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:06:33.525267 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.524730    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:33.525267 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.524879    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:34.024849025 +0000 UTC m=+2.973866492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:33.527324 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.527298    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26ww9\" (UniqueName: \"kubernetes.io/projected/6c4dd699-0297-458a-bc7a-1f9d38048e55-kube-api-access-26ww9\") pod \"ovnkube-node-cdmmc\" (UID: \"6c4dd699-0297-458a-bc7a-1f9d38048e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.527561 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.527539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krz5k\" (UniqueName: \"kubernetes.io/projected/29d473db-3c07-45ba-b602-7af6780e7e88-kube-api-access-krz5k\") pod \"node-resolver-r8567\" (UID: \"29d473db-3c07-45ba-b602-7af6780e7e88\") " pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.530258 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.530234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5v5\" (UniqueName: \"kubernetes.io/projected/f88d2deb-323b-4573-8132-689d02eb00e8-kube-api-access-hb5v5\") pod \"multus-additional-cni-plugins-dnh2g\" (UID: \"f88d2deb-323b-4573-8132-689d02eb00e8\") " pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.621069 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:33.621069 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-cnibin\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx599\" (UniqueName: \"kubernetes.io/projected/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-kube-api-access-nx599\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-run\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-sys\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.621199    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-kubelet\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-registration-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-cni-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-modprobe-d\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-kubelet\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-run\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-sys\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621348 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.621340    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:34.121318138 +0000 UTC m=+3.070335607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-kubernetes\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-cnibin\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-registration-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-kubernetes\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-modprobe-d\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7r2j\" (UniqueName: \"kubernetes.io/projected/c08f3d1c-a2d6-4668-91bd-7072d254a978-kube-api-access-b7r2j\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-cni-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7psv\" (UniqueName: \"kubernetes.io/projected/2f2a7bf0-07c3-454e-a8f8-018379221c64-kube-api-access-p7psv\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d60dd821-7191-45cd-93cb-54131193f903-etc-tuned\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-hostroot\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysconfig\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d60dd821-7191-45cd-93cb-54131193f903-tmp\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-multus-certs\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-hostroot\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-lib-modules\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-var-lib-kubelet\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysconfig\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.621880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-host\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f2a7bf0-07c3-454e-a8f8-018379221c64-iptables-alerter-script\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c08f3d1c-a2d6-4668-91bd-7072d254a978-serviceca\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-var-lib-kubelet\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-lib-modules\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aea8d8b2-fea6-4098-ba33-99a22b7022a4-kubelet-config\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621772    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-multus-certs\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-sys-fs\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlld\" (UniqueName: \"kubernetes.io/projected/d60dd821-7191-45cd-93cb-54131193f903-kube-api-access-xwlld\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-device-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-system-cni-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aea8d8b2-fea6-4098-ba33-99a22b7022a4-kubelet-config\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-sys-fs\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.621994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-socket-dir-parent\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-k8s-cni-cncf-io\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-device-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.622770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-cni-multus\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-cni-multus\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-system-cni-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c08f3d1c-a2d6-4668-91bd-7072d254a978-serviceca\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-socket-dir-parent\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-k8s-cni-cncf-io\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-host\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5g9\" (UniqueName: \"kubernetes.io/projected/f02e7e8e-7628-4291-bcc6-203da9da2216-kube-api-access-8l5g9\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-cni-binary-copy\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-cni-bin\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622367    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aea8d8b2-fea6-4098-ba33-99a22b7022a4-dbus\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-socket-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-os-release\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-conf-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-daemon-config\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.623576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aea8d8b2-fea6-4098-ba33-99a22b7022a4-dbus\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f2a7bf0-07c3-454e-a8f8-018379221c64-host-slash\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622527    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f661cd77-7517-40dc-a6ac-797f159a995b-socket-dir\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-os-release\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-var-lib-cni-bin\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f2a7bf0-07c3-454e-a8f8-018379221c64-host-slash\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-conf-dir\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.622610    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwcs\" (UniqueName: \"kubernetes.io/projected/f661cd77-7517-40dc-a6ac-797f159a995b-kube-api-access-2rwcs\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-systemd\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:33.622661    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:34.122643099 +0000 UTC m=+3.071660562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-systemd\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysctl-d\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysctl-conf\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-etc-kubernetes\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-netns\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c08f3d1c-a2d6-4668-91bd-7072d254a978-host\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622867    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c08f3d1c-a2d6-4668-91bd-7072d254a978-host\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622867    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-cni-binary-copy\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622920    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-etc-kubernetes\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysctl-conf\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-host-run-netns\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d60dd821-7191-45cd-93cb-54131193f903-etc-sysctl-d\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.622976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f2a7bf0-07c3-454e-a8f8-018379221c64-iptables-alerter-script\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.623065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-multus-daemon-config\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.624124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d60dd821-7191-45cd-93cb-54131193f903-tmp\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.624800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.624255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d60dd821-7191-45cd-93cb-54131193f903-etc-tuned\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.630690 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.630633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7r2j\" (UniqueName: \"kubernetes.io/projected/c08f3d1c-a2d6-4668-91bd-7072d254a978-kube-api-access-b7r2j\") pod \"node-ca-ggpgm\" (UID: \"c08f3d1c-a2d6-4668-91bd-7072d254a978\") " pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.631914 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.631882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwcs\" (UniqueName: \"kubernetes.io/projected/f661cd77-7517-40dc-a6ac-797f159a995b-kube-api-access-2rwcs\") pod \"aws-ebs-csi-driver-node-bbm2s\" (UID: \"f661cd77-7517-40dc-a6ac-797f159a995b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.632043 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.631928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5g9\" (UniqueName: \"kubernetes.io/projected/f02e7e8e-7628-4291-bcc6-203da9da2216-kube-api-access-8l5g9\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:33.632115 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.632080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx599\" (UniqueName: \"kubernetes.io/projected/55e71a5a-1ae0-431f-8c4f-6222fb9d05ee-kube-api-access-nx599\") pod \"multus-mnmrf\" (UID: \"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee\") " pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.632458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.632411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlld\" (UniqueName: \"kubernetes.io/projected/d60dd821-7191-45cd-93cb-54131193f903-kube-api-access-xwlld\") pod \"tuned-qdwr2\" (UID: \"d60dd821-7191-45cd-93cb-54131193f903\") " pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.632667 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.632634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7psv\" (UniqueName: \"kubernetes.io/projected/2f2a7bf0-07c3-454e-a8f8-018379221c64-kube-api-access-p7psv\") pod \"iptables-alerter-6k7qx\" (UID: \"2f2a7bf0-07c3-454e-a8f8-018379221c64\") " pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.707492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.707406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8567"
Jul 15 13:06:33.716975 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.716949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:33.725581 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.725558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnh2g"
Jul 15 13:06:33.730094 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.730076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:06:33.736555 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.736534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s"
Jul 15 13:06:33.742041 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.742019    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mnmrf"
Jul 15 13:06:33.748528 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.748512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdwr2"
Jul 15 13:06:33.754877 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.754860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ggpgm"
Jul 15 13:06:33.762350 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.762333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6k7qx"
Jul 15 13:06:33.821656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:33.821624    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:06:34.025692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.025600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:34.025841 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.025759    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:06:34.025841 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.025778    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:06:34.025841 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.025786    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:34.025841 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.025838    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:35.02582204 +0000 UTC m=+3.974839503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:34.126799 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.126764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:34.126971 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.126812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:34.126971 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.126927    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:34.127084 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.126980    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:35.126966392 +0000 UTC m=+4.075983841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:34.127084 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.126927    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:34.127084 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.127069    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:35.127055069 +0000 UTC m=+4.076072528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:34.293072 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.293043    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4dd699_0297_458a_bc7a_1f9d38048e55.slice/crio-54409fef82fd226c4c992ae2cfd34a6055773a2eae4ea95b79d7b2ebfed90f77 WatchSource:0}: Error finding container 54409fef82fd226c4c992ae2cfd34a6055773a2eae4ea95b79d7b2ebfed90f77: Status 404 returned error can't find the container with id 54409fef82fd226c4c992ae2cfd34a6055773a2eae4ea95b79d7b2ebfed90f77
Jul 15 13:06:34.298206 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.298127    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e71a5a_1ae0_431f_8c4f_6222fb9d05ee.slice/crio-bb4516410aebf8016fd0021470663bf96a2a350102156dde41fbae3db837be9a WatchSource:0}: Error finding container bb4516410aebf8016fd0021470663bf96a2a350102156dde41fbae3db837be9a: Status 404 returned error can't find the container with id bb4516410aebf8016fd0021470663bf96a2a350102156dde41fbae3db837be9a
Jul 15 13:06:34.302529 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.302438    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d473db_3c07_45ba_b602_7af6780e7e88.slice/crio-36b7249db2dbc6e3e5ed0a904f69bf73680399406598f9c5d05434cb8a9da50d WatchSource:0}: Error finding container 36b7249db2dbc6e3e5ed0a904f69bf73680399406598f9c5d05434cb8a9da50d: Status 404 returned error can't find the container with id 36b7249db2dbc6e3e5ed0a904f69bf73680399406598f9c5d05434cb8a9da50d
Jul 15 13:06:34.303861 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.303805    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08f3d1c_a2d6_4668_91bd_7072d254a978.slice/crio-eb29f4fec7806e20bc9632e21128396754e1449e62c99abf2a2b6b0eaca13509 WatchSource:0}: Error finding container eb29f4fec7806e20bc9632e21128396754e1449e62c99abf2a2b6b0eaca13509: Status 404 returned error can't find the container with id eb29f4fec7806e20bc9632e21128396754e1449e62c99abf2a2b6b0eaca13509
Jul 15 13:06:34.305089 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.305066    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a78dd4_98bf_4c8b_b4cb_50e16b079019.slice/crio-622b81b98fab836c13a18dcf032c058b905d3d5bce32c59b17f6614b2ba99401 WatchSource:0}: Error finding container 622b81b98fab836c13a18dcf032c058b905d3d5bce32c59b17f6614b2ba99401: Status 404 returned error can't find the container with id 622b81b98fab836c13a18dcf032c058b905d3d5bce32c59b17f6614b2ba99401
Jul 15 13:06:34.306152 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.306120    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60dd821_7191_45cd_93cb_54131193f903.slice/crio-0bf4ecdd59fffc04ac3e9bd736e8cdb3eca9d75ae044d6fd8d12aafbc2e08e93 WatchSource:0}: Error finding container 0bf4ecdd59fffc04ac3e9bd736e8cdb3eca9d75ae044d6fd8d12aafbc2e08e93: Status 404 returned error can't find the container with id 0bf4ecdd59fffc04ac3e9bd736e8cdb3eca9d75ae044d6fd8d12aafbc2e08e93
Jul 15 13:06:34.307867 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.307633    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2a7bf0_07c3_454e_a8f8_018379221c64.slice/crio-fd345f5c9ecdaba5780cd72cc0558d90019791cdd4bcab8f00a41fe818ddb8a8 WatchSource:0}: Error finding container fd345f5c9ecdaba5780cd72cc0558d90019791cdd4bcab8f00a41fe818ddb8a8: Status 404 returned error can't find the container with id fd345f5c9ecdaba5780cd72cc0558d90019791cdd4bcab8f00a41fe818ddb8a8
Jul 15 13:06:34.309059 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.308749    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf661cd77_7517_40dc_a6ac_797f159a995b.slice/crio-86b7b1d8549ec875408311906d9f5ebfe49a3df0d0d8b2a6a6163725a9d08e70 WatchSource:0}: Error finding container 86b7b1d8549ec875408311906d9f5ebfe49a3df0d0d8b2a6a6163725a9d08e70: Status 404 returned error can't find the container with id 86b7b1d8549ec875408311906d9f5ebfe49a3df0d0d8b2a6a6163725a9d08e70
Jul 15 13:06:34.309540 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:06:34.309439    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88d2deb_323b_4573_8132_689d02eb00e8.slice/crio-ea0ef18910484e65cc543df99386e6535c687185de658d5404cdab5f8fd7d263 WatchSource:0}: Error finding container ea0ef18910484e65cc543df99386e6535c687185de658d5404cdab5f8fd7d263: Status 404 returned error can't find the container with id ea0ef18910484e65cc543df99386e6535c687185de658d5404cdab5f8fd7d263
Jul 15 13:06:34.450404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.450183    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:01:33 +0000 UTC" deadline="2028-03-29 01:23:36.589572592 +0000 UTC"
Jul 15 13:06:34.450404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.450401    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14940h17m2.139175804s"
Jul 15 13:06:34.579584 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.579553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:34.579696 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:34.579656    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:34.587889 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.587860    2561 generic.go:356] "Generic (PLEG): container finished" podID="b1c96d8911d62c1c0e4352675d5a0883" containerID="0a56cb644367d379b0ebd5ef7e79f501f09924a9bed727fadedfe38fab15e759" exitCode=0
Jul 15 13:06:34.588067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.587941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" event={"ID":"b1c96d8911d62c1c0e4352675d5a0883","Type":"ContainerDied","Data":"0a56cb644367d379b0ebd5ef7e79f501f09924a9bed727fadedfe38fab15e759"}
Jul 15 13:06:34.589131 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.589106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ggpgm" event={"ID":"c08f3d1c-a2d6-4668-91bd-7072d254a978","Type":"ContainerStarted","Data":"eb29f4fec7806e20bc9632e21128396754e1449e62c99abf2a2b6b0eaca13509"}
Jul 15 13:06:34.590178 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.590156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s" event={"ID":"f661cd77-7517-40dc-a6ac-797f159a995b","Type":"ContainerStarted","Data":"86b7b1d8549ec875408311906d9f5ebfe49a3df0d0d8b2a6a6163725a9d08e70"}
Jul 15 13:06:34.591305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.591267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6k7qx" event={"ID":"2f2a7bf0-07c3-454e-a8f8-018379221c64","Type":"ContainerStarted","Data":"fd345f5c9ecdaba5780cd72cc0558d90019791cdd4bcab8f00a41fe818ddb8a8"}
Jul 15 13:06:34.592397 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.592377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqb5j" event={"ID":"52a78dd4-98bf-4c8b-b4cb-50e16b079019","Type":"ContainerStarted","Data":"622b81b98fab836c13a18dcf032c058b905d3d5bce32c59b17f6614b2ba99401"}
Jul 15 13:06:34.593388 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.593369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8567" event={"ID":"29d473db-3c07-45ba-b602-7af6780e7e88","Type":"ContainerStarted","Data":"36b7249db2dbc6e3e5ed0a904f69bf73680399406598f9c5d05434cb8a9da50d"}
Jul 15 13:06:34.595540 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.595513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"54409fef82fd226c4c992ae2cfd34a6055773a2eae4ea95b79d7b2ebfed90f77"}
Jul 15 13:06:34.597588 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.597565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal" event={"ID":"bf6b0844b00827ab6eeff6cc6879a70c","Type":"ContainerStarted","Data":"2fb26a1ed6eed0ca63268727444adf3dba803185c3a5ee812cd64ab51b704b60"}
Jul 15 13:06:34.598737 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.598716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerStarted","Data":"ea0ef18910484e65cc543df99386e6535c687185de658d5404cdab5f8fd7d263"}
Jul 15 13:06:34.599712 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.599694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdwr2" event={"ID":"d60dd821-7191-45cd-93cb-54131193f903","Type":"ContainerStarted","Data":"0bf4ecdd59fffc04ac3e9bd736e8cdb3eca9d75ae044d6fd8d12aafbc2e08e93"}
Jul 15 13:06:34.600633 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.600615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mnmrf" event={"ID":"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee","Type":"ContainerStarted","Data":"bb4516410aebf8016fd0021470663bf96a2a350102156dde41fbae3db837be9a"}
Jul 15 13:06:34.619099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:34.619034    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal" podStartSLOduration=2.619012827 podStartE2EDuration="2.619012827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:34.61865368 +0000 UTC m=+3.567671152" watchObservedRunningTime="2026-07-15 13:06:34.619012827 +0000 UTC m=+3.568030299"
Jul 15 13:06:35.035187 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.034875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:35.035187 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.035174    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:06:35.035982 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.035223    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:06:35.035982 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.035242    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:35.035982 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.035323    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:37.035302089 +0000 UTC m=+5.984319552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:35.135834 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.135792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:35.136028 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.135891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:35.136028 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.136022    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:35.136149 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.136086    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:37.136066097 +0000 UTC m=+6.085083561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:35.136214 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.136156    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:35.136214 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.136197    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:37.13617928 +0000 UTC m=+6.085196732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:35.451001 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.450905    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:01:33 +0000 UTC" deadline="2028-04-21 19:43:52.620030174 +0000 UTC"
Jul 15 13:06:35.451001 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.450950    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15510h37m17.169085702s"
Jul 15 13:06:35.487385 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.487353    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:06:35.579550 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.579505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:35.579734 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.579655    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:35.580142 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.580121    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:35.580230 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:35.580216    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:35.611786 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.610752    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" event={"ID":"b1c96d8911d62c1c0e4352675d5a0883","Type":"ContainerStarted","Data":"6a595c851150fa9885b9a248308b5d30488fd241f0db345f97b23a5de03f43fb"}
Jul 15 13:06:35.630568 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:35.630511    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" podStartSLOduration=3.630491133 podStartE2EDuration="3.630491133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:35.629247111 +0000 UTC m=+4.578264583" watchObservedRunningTime="2026-07-15 13:06:35.630491133 +0000 UTC m=+4.579508604"
Jul 15 13:06:36.579174 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:36.579137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:36.579651 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:36.579264    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:37.056634 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:37.056533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:37.056787 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.056754    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:06:37.056787 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.056777    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:06:37.056893 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.056791    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:37.056893 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.056858    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:41.056837194 +0000 UTC m=+10.005854666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:37.157649 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:37.157490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:37.157649 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:37.157573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:37.157921 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.157677    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:37.157921 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.157749    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:41.157732617 +0000 UTC m=+10.106750068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:37.158316 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.158191    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:37.158316 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.158260    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:41.158243759 +0000 UTC m=+10.107261210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:37.580237 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:37.579623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:37.580237 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.579773    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:37.580237 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:37.579632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:37.580237 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:37.580191    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:38.578950 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:38.578914    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:38.579124 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:38.579060    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:39.586099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:39.585347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:39.586099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:39.585352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:39.586099 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:39.585648    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:39.586714 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:39.586184    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:40.579749 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:40.579716    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:40.579922 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:40.579842    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:41.092902 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.092814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:41.093391 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.093032    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:06:41.093391 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.093052    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:06:41.093391 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.093064    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:41.093391 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.093122    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:49.093103023 +0000 UTC m=+18.042120477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:41.193613 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.193578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:41.193751 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.193674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:41.193833 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.193806    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:41.193882 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.193870    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:49.193852259 +0000 UTC m=+18.142869710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:41.194444 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.194324    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:41.194444 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.194383    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:06:49.194368206 +0000 UTC m=+18.143385657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:41.581253 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.580079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:41.581253 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.580194    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:41.581253 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.580559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:41.581253 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:41.580656    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:41.628890 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.628630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqb5j" event={"ID":"52a78dd4-98bf-4c8b-b4cb-50e16b079019","Type":"ContainerStarted","Data":"93eaaf14ae0d972cf1e507cfb3e75d089212a21b42b7e93515df1ee95369c965"}
Jul 15 13:06:41.632304 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.631975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8567" event={"ID":"29d473db-3c07-45ba-b602-7af6780e7e88","Type":"ContainerStarted","Data":"1517d4f4bdcb7e1e7d3a6a2ceafc2ada2a33b0401e1ac92a45a511cbdb51ae47"}
Jul 15 13:06:41.642383 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.641082    2561 generic.go:356] "Generic (PLEG): container finished" podID="f88d2deb-323b-4573-8132-689d02eb00e8" containerID="09e811be46edfeaf2125093331c0b62fe84889242c022367515fc1db1605fd65" exitCode=0
Jul 15 13:06:41.642383 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.641188    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerDied","Data":"09e811be46edfeaf2125093331c0b62fe84889242c022367515fc1db1605fd65"}
Jul 15 13:06:41.647363 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.647080    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lqb5j" podStartSLOduration=4.124421139 podStartE2EDuration="10.647059091s" totalImagesPullingTime="6.522637952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:41.647021894 +0000 UTC m=+10.596039366" watchObservedRunningTime="2026-07-15 13:06:41.647059091 +0000 UTC m=+10.596076563"
Jul 15 13:06:41.649305 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.649260    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s" event={"ID":"f661cd77-7517-40dc-a6ac-797f159a995b","Type":"ContainerStarted","Data":"934f745430875c118c25f9f3d75146f2812d1d5b6a57ed290bbbc291206b5ef8"}
Jul 15 13:06:41.693538 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:41.693481    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r8567" podStartSLOduration=4.163002535 podStartE2EDuration="10.693459524s" totalImagesPullingTime="6.530456989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:41.669962433 +0000 UTC m=+10.618979933" watchObservedRunningTime="2026-07-15 13:06:41.693459524 +0000 UTC m=+10.642476996"
Jul 15 13:06:42.241140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:42.241053    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:42.241675 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:42.241653    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:42.579894 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:42.579816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:42.580042 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:42.579950    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:42.654086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:42.654036    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:42.654535 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:42.654492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lqb5j"
Jul 15 13:06:43.580135 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:43.579888    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:43.580586 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:43.580293    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:43.580666 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:43.580592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:43.580768 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:43.580739    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:43.657536 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:43.657497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6k7qx" event={"ID":"2f2a7bf0-07c3-454e-a8f8-018379221c64","Type":"ContainerStarted","Data":"3ef4bbbb544f87f2cbe20618b1ca77d438136416d8555e459f97e6e7c02e9451"}
Jul 15 13:06:43.673349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:43.673290    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6k7qx" podStartSLOduration=6.151611532 podStartE2EDuration="12.673247473s" totalImagesPullingTime="6.521635941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:43.672683222 +0000 UTC m=+12.621700694" watchObservedRunningTime="2026-07-15 13:06:43.673247473 +0000 UTC m=+12.622264945"
Jul 15 13:06:44.578878 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:44.578840    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:44.579054 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:44.578992    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:45.579616 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:45.579579    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:45.580199 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:45.579584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:45.580199 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:45.579710    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:45.580199 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:45.579795    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:46.579375 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:46.579337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:46.579550 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:46.579443    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:47.579119 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:47.579067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:47.579119 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:47.579105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:47.579900 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:47.579214    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:47.579900 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:47.579367    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:48.579031 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:48.578998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:48.579251 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:48.579135    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:49.158586 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:49.158539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:49.158758 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.158714    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:06:49.158758 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.158736    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:06:49.158758 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.158746    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:49.158877 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.158801    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:05.158786982 +0000 UTC m=+34.107804448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:06:49.259256 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:49.259224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:49.259445 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:49.259296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:49.259445 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.259381    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:49.259445 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.259413    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:49.259445 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.259444    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:05.259429862 +0000 UTC m=+34.208447316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:06:49.259670 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.259458    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:05.259451449 +0000 UTC m=+34.208468898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:06:49.579007 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:49.578987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:49.579094 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:49.578986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:49.579135 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.579092    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:49.579202 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:49.579179    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:50.579080 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:50.579043    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:50.579575 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:50.579165    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:51.580705 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:51.580662    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:51.581302 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:51.580774    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:51.581302 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:51.580854    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:51.581302 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:51.580957    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:52.579672 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:52.579638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:52.579838 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:52.579760    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:53.582384 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:53.582352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:53.582965 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:53.582360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:53.582965 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:53.582477    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:53.582965 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:53.582565    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:54.165947 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.165731    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 13:06:54.470010 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.469892    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:06:54.165929306Z","UUID":"1ca06d54-55eb-4776-8dc0-f4df6abf339f","Handler":null,"Name":"","Endpoint":""}
Jul 15 13:06:54.471959 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.471934    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 13:06:54.472130 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.471980    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 13:06:54.579741 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.579670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:54.579889 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:54.579787    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:54.679728 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.679688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mnmrf" event={"ID":"55e71a5a-1ae0-431f-8c4f-6222fb9d05ee","Type":"ContainerStarted","Data":"d937b4684df259f1a13f226af3a3c0c119ad89ce9f2dd04398bf868bf7de9d9d"}
Jul 15 13:06:54.681373 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.681343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ggpgm" event={"ID":"c08f3d1c-a2d6-4668-91bd-7072d254a978","Type":"ContainerStarted","Data":"d6b158b579b996e0610dbe8c63a70bb91046a3ad6b961c43dc09a083d2529219"}
Jul 15 13:06:54.683566 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.683540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s" event={"ID":"f661cd77-7517-40dc-a6ac-797f159a995b","Type":"ContainerStarted","Data":"d62d6e02ca42e093470591dbddbba8feb9f1023e0a3f540d9e7974ccc3625430"}
Jul 15 13:06:54.685229 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.685201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdwr2" event={"ID":"d60dd821-7191-45cd-93cb-54131193f903","Type":"ContainerStarted","Data":"7303c3f31398e4fc484603286febd9af18781bb68402a21df3d2269abdaa0779"}
Jul 15 13:06:54.707636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.707569    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mnmrf" podStartSLOduration=4.003718195 podStartE2EDuration="23.707553084s" totalImagesPullingTime="19.703834889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:54.707006092 +0000 UTC m=+23.656023563" watchObservedRunningTime="2026-07-15 13:06:54.707553084 +0000 UTC m=+23.656570554"
Jul 15 13:06:54.742415 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.742361    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qdwr2" podStartSLOduration=4.048005739 podStartE2EDuration="23.742342979s" totalImagesPullingTime="19.69433724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:54.741985112 +0000 UTC m=+23.691002630" watchObservedRunningTime="2026-07-15 13:06:54.742342979 +0000 UTC m=+23.691360447"
Jul 15 13:06:54.742619 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:54.742478    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ggpgm" podStartSLOduration=4.058019407 podStartE2EDuration="23.742471284s" totalImagesPullingTime="19.684451877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:54.723635364 +0000 UTC m=+23.672652837" watchObservedRunningTime="2026-07-15 13:06:54.742471284 +0000 UTC m=+23.691488755"
Jul 15 13:06:55.578878 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:55.578840    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:55.579074 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:55.578890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:55.579074 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:55.579001    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:55.579157 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:55.579133    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:56.579492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.579455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:56.579892 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:56.579565    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:56.692501 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.692477    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:06:56.692820 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.692796    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c4dd699-0297-458a-bc7a-1f9d38048e55" containerID="76c840d733af1155c664944f30bd10a40e95462efb60a7b33cf56f3f8de402db" exitCode=1
Jul 15 13:06:56.692899 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.692865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"ccf9eb0f90e4ad31bb649c421b34ba9f7eaf0789472006a7c77a2236cced99ed"}
Jul 15 13:06:56.692940 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.692931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"52bdd1f051bfd8f62a5a2c9ce1d38a29bcc6fe65bbf72b7674376fb4bde30192"}
Jul 15 13:06:56.692986 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.692969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"a2b4c1624b5ede6904e6bb59674f838829707004159607a5d62d54421c829882"}
Jul 15 13:06:56.693025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.693000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"dd23ef16926d5fea61a2a1f0842e23afd4f8f9d8b6aed352a320fbca1bf42d22"}
Jul 15 13:06:56.693066 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.693029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerDied","Data":"76c840d733af1155c664944f30bd10a40e95462efb60a7b33cf56f3f8de402db"}
Jul 15 13:06:56.693066 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.693058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"81a461f8e8b34b1f5203d7f6c1fa3ba050c298e348e0d6c8a3ea419b3c0e9fec"}
Jul 15 13:06:56.694659 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.694635    2561 generic.go:356] "Generic (PLEG): container finished" podID="f88d2deb-323b-4573-8132-689d02eb00e8" containerID="b07176e4f90ab081ef756d569e79fbfe28369638a03f41598f25fa14c08b57d6" exitCode=0
Jul 15 13:06:56.694771 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:56.694680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerDied","Data":"b07176e4f90ab081ef756d569e79fbfe28369638a03f41598f25fa14c08b57d6"}
Jul 15 13:06:57.578856 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:57.578821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:57.579040 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:57.578927    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:57.579040 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:57.578982    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:57.579108 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:57.579079    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:57.698810 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:57.698778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s" event={"ID":"f661cd77-7517-40dc-a6ac-797f159a995b","Type":"ContainerStarted","Data":"1dc71c42e7e357c35720c5d8f0e78ae53e1276febe098a986034e5f5609ccea1"}
Jul 15 13:06:57.717377 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:57.717329    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbm2s" podStartSLOduration=4.594740138 podStartE2EDuration="26.717314496s" totalImagesPullingTime="22.122574358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:57.717096563 +0000 UTC m=+26.666114034" watchObservedRunningTime="2026-07-15 13:06:57.717314496 +0000 UTC m=+26.666331963"
Jul 15 13:06:58.578774 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:58.578742    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:06:58.578972 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:58.578860    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:06:58.702628 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:58.702593    2561 generic.go:356] "Generic (PLEG): container finished" podID="f88d2deb-323b-4573-8132-689d02eb00e8" containerID="d5096de313d6ad81f31fcc26e1f269c1a4923c5558d75d5c0a8c6bd2d469481b" exitCode=0
Jul 15 13:06:58.703025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:58.702673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerDied","Data":"d5096de313d6ad81f31fcc26e1f269c1a4923c5558d75d5c0a8c6bd2d469481b"}
Jul 15 13:06:59.579130 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:59.579095    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:06:59.579319 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:59.579216    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:06:59.579319 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:59.579291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:06:59.579436 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:06:59.579415    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:06:59.709988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:59.709966    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:06:59.710448 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:06:59.710360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"c790312d4c3e97a7ec3290ad75e28e4fe8f389feb80bda3c4f44396797f066f0"}
Jul 15 13:07:00.579805 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:00.579770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:00.579955 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:00.579879    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:07:00.714588 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:00.714548    2561 generic.go:356] "Generic (PLEG): container finished" podID="f88d2deb-323b-4573-8132-689d02eb00e8" containerID="37c31e7d0baca924c90a4b7b8371099c8ebfa494ac2c2dea6b97b97b6634800d" exitCode=0
Jul 15 13:07:00.714951 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:00.714621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerDied","Data":"37c31e7d0baca924c90a4b7b8371099c8ebfa494ac2c2dea6b97b97b6634800d"}
Jul 15 13:07:01.579956 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.579783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:01.580155 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.579825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:01.580155 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:01.580088    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:07:01.580155 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:01.580013    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:07:01.720448 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.720421    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:07:01.720915 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.720749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"4a662536df6cd4f9c82255f811b5508491b1934f166777d57e005e7746a86990"}
Jul 15 13:07:01.721038 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.721014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:07:01.721154 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.721098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:07:01.721216 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.721202    2561 scope.go:117] "RemoveContainer" containerID="76c840d733af1155c664944f30bd10a40e95462efb60a7b33cf56f3f8de402db"
Jul 15 13:07:01.736853 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:01.736833    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:07:02.579167 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:02.579138    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:02.579356 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:02.579250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:07:02.726668 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:02.726642    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:07:02.727034 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:02.726958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" event={"ID":"6c4dd699-0297-458a-bc7a-1f9d38048e55","Type":"ContainerStarted","Data":"78a98c42c2589249138e832ba45945e408d0518f2f115c374bbe4f82f8329269"}
Jul 15 13:07:02.727442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:02.727412    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:07:02.743510 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:02.743480    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:07:02.762116 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:02.762068    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc" podStartSLOduration=10.31291162 podStartE2EDuration="31.762053908s" totalImagesPullingTime="21.449142288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:02.76070262 +0000 UTC m=+31.709720091" watchObservedRunningTime="2026-07-15 13:07:02.762053908 +0000 UTC m=+31.711071380"
Jul 15 13:07:03.116111 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:03.116068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2fj7r"]
Jul 15 13:07:03.116295 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:03.116207    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:03.116351 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:03.116324    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:07:03.118978 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:03.118932    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99bsw"]
Jul 15 13:07:03.119126 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:03.119048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:03.119199 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:03.119158    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:07:03.119550 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:03.119525    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqjmp"]
Jul 15 13:07:03.119648 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:03.119609    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:03.119704 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:03.119688    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:07:04.579599 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:04.579543    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:04.579599 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:04.579593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:04.580071 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:04.579593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:04.580071 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:04.579661    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:07:04.580071 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:04.579771    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:07:04.580071 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:04.579849    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:07:05.173050 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:05.173011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:05.173227 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.173181    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:07:05.173227 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.173214    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:07:05.173227 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.173228    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hpqt7 for pod openshift-network-diagnostics/network-check-target-99bsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:07:05.173380 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.173315    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7 podName:27efc05c-2a46-4b31-96fe-6775b4224f47 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:37.173293758 +0000 UTC m=+66.122311222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpqt7" (UniqueName: "kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7") pod "network-check-target-99bsw" (UID: "27efc05c-2a46-4b31-96fe-6775b4224f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:07:05.273940 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:05.273843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:05.273940 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:05.273916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:05.274144 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.274051    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:07:05.274144 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.274067    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:07:05.274144 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.274120    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret podName:aea8d8b2-fea6-4098-ba33-99a22b7022a4 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:37.274104406 +0000 UTC m=+66.223121882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret") pod "global-pull-secret-syncer-rqjmp" (UID: "aea8d8b2-fea6-4098-ba33-99a22b7022a4") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:07:05.274144 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:05.274136    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:37.274128762 +0000 UTC m=+66.223146211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:07:06.579596 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:06.579560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:06.580016 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:06.579562    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:06.580016 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:06.579681    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:07:06.580016 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:06.579693    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:06.580016 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:06.579783    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:07:06.580016 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:06.579891    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:07:07.744126 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:07.744094    2561 generic.go:356] "Generic (PLEG): container finished" podID="f88d2deb-323b-4573-8132-689d02eb00e8" containerID="f5719bd788e5e34b99a36637e72e7ac44c9354d92be74f4eb99ef5421968366f" exitCode=0
Jul 15 13:07:07.744126 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:07.744136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerDied","Data":"f5719bd788e5e34b99a36637e72e7ac44c9354d92be74f4eb99ef5421968366f"}
Jul 15 13:07:08.579189 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.579151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:08.579436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.579162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:08.579436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.579301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:08.579436 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:08.579296    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99bsw" podUID="27efc05c-2a46-4b31-96fe-6775b4224f47"
Jul 15 13:07:08.579436 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:08.579377    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:07:08.579656 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:08.579438    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqjmp" podUID="aea8d8b2-fea6-4098-ba33-99a22b7022a4"
Jul 15 13:07:08.749302 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.749207    2561 generic.go:356] "Generic (PLEG): container finished" podID="f88d2deb-323b-4573-8132-689d02eb00e8" containerID="35dad622221d0c43d0d9d8d50933b7d43720782d58a94ea1feecbd209805044d" exitCode=0
Jul 15 13:07:08.749710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.749294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerDied","Data":"35dad622221d0c43d0d9d8d50933b7d43720782d58a94ea1feecbd209805044d"}
Jul 15 13:07:08.839823 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.839800    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeReady"
Jul 15 13:07:08.839970 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.839958    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 13:07:08.883219 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.883193    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lmkbx"]
Jul 15 13:07:08.899922 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.899888    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-smj5h"]
Jul 15 13:07:08.900069 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.900032    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:08.902783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.902565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 13:07:08.902783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.902594    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-txt24\""
Jul 15 13:07:08.902783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.902615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 13:07:08.917425 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.917399    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lmkbx"]
Jul 15 13:07:08.917529 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.917439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smj5h"]
Jul 15 13:07:08.917529 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.917503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:08.920073 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.920054    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 13:07:08.920180 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.920086    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 13:07:08.920180 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.920111    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 13:07:08.920180 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:08.920058    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htl88\""
Jul 15 13:07:09.003928 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.003841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec15faff-43dc-4453-b2e5-025a8fa7fd50-cert\") pod \"ingress-canary-smj5h\" (UID: \"ec15faff-43dc-4453-b2e5-025a8fa7fd50\") " pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.003928 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.003876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwdx\" (UniqueName: \"kubernetes.io/projected/ec15faff-43dc-4453-b2e5-025a8fa7fd50-kube-api-access-hxwdx\") pod \"ingress-canary-smj5h\" (UID: \"ec15faff-43dc-4453-b2e5-025a8fa7fd50\") " pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.003928 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.003910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.004187 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.004001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtts\" (UniqueName: \"kubernetes.io/projected/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-kube-api-access-lqtts\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.004187 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.004037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-tmp-dir\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.004187 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.004085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-config-volume\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.105122 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-config-volume\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.105252 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec15faff-43dc-4453-b2e5-025a8fa7fd50-cert\") pod \"ingress-canary-smj5h\" (UID: \"ec15faff-43dc-4453-b2e5-025a8fa7fd50\") " pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.105252 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwdx\" (UniqueName: \"kubernetes.io/projected/ec15faff-43dc-4453-b2e5-025a8fa7fd50-kube-api-access-hxwdx\") pod \"ingress-canary-smj5h\" (UID: \"ec15faff-43dc-4453-b2e5-025a8fa7fd50\") " pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.105362 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.105406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtts\" (UniqueName: \"kubernetes.io/projected/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-kube-api-access-lqtts\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.105406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-tmp-dir\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.105528 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:09.105504    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:09.105603 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:09.105591    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:09.605568311 +0000 UTC m=+38.554585762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:09.105682 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-tmp-dir\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.105735 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.105722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-config-volume\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.109391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.109365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec15faff-43dc-4453-b2e5-025a8fa7fd50-cert\") pod \"ingress-canary-smj5h\" (UID: \"ec15faff-43dc-4453-b2e5-025a8fa7fd50\") " pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.115725 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.115702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtts\" (UniqueName: \"kubernetes.io/projected/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-kube-api-access-lqtts\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.115911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.115891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwdx\" (UniqueName: \"kubernetes.io/projected/ec15faff-43dc-4453-b2e5-025a8fa7fd50-kube-api-access-hxwdx\") pod \"ingress-canary-smj5h\" (UID: \"ec15faff-43dc-4453-b2e5-025a8fa7fd50\") " pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.225183 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.225150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smj5h"
Jul 15 13:07:09.426449 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.426196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smj5h"]
Jul 15 13:07:09.430639 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:07:09.430614    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec15faff_43dc_4453_b2e5_025a8fa7fd50.slice/crio-9c87eafc63d3047d24550ef67b3cfb5a20e63ea3b0c52db21c26a332320bfe83 WatchSource:0}: Error finding container 9c87eafc63d3047d24550ef67b3cfb5a20e63ea3b0c52db21c26a332320bfe83: Status 404 returned error can't find the container with id 9c87eafc63d3047d24550ef67b3cfb5a20e63ea3b0c52db21c26a332320bfe83
Jul 15 13:07:09.609739 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.609640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:09.609875 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:09.609797    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:09.609875 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:09.609867    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:10.609845667 +0000 UTC m=+39.558863125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:09.753145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.753109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smj5h" event={"ID":"ec15faff-43dc-4453-b2e5-025a8fa7fd50","Type":"ContainerStarted","Data":"9c87eafc63d3047d24550ef67b3cfb5a20e63ea3b0c52db21c26a332320bfe83"}
Jul 15 13:07:09.756729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.756699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" event={"ID":"f88d2deb-323b-4573-8132-689d02eb00e8","Type":"ContainerStarted","Data":"55aa378bd87fe9ca0cfd64a48b9862d9fbf825d48a1733ffea6eb2e70971e7cb"}
Jul 15 13:07:09.781475 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:09.781421    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dnh2g" podStartSLOduration=9.047773148 podStartE2EDuration="38.781397391s" totalImagesPullingTime="29.733624243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:09.778834285 +0000 UTC m=+38.727851775" watchObservedRunningTime="2026-07-15 13:07:09.781397391 +0000 UTC m=+38.730414870"
Jul 15 13:07:10.578876 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.578839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:10.579057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.578890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:10.579057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.578965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:10.581764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.581740    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 13:07:10.581889 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.581839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 13:07:10.582809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.582788    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 13:07:10.582923 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.582892    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 13:07:10.582923 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.582901    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nr6v2\""
Jul 15 13:07:10.583040 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.582994    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8tgt2\""
Jul 15 13:07:10.618368 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:10.618333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:10.618519 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:10.618488    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:10.618563 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:10.618552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:12.618531667 +0000 UTC m=+41.567549119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:12.635161 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:12.634995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:12.635161 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:12.635151    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:12.635575 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:12.635219    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:16.635202701 +0000 UTC m=+45.584220150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:12.765391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:12.765359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smj5h" event={"ID":"ec15faff-43dc-4453-b2e5-025a8fa7fd50","Type":"ContainerStarted","Data":"ef8ba3e478a635f5585e842d4d1579991023ede7e6fcc9135ef00667efd69f76"}
Jul 15 13:07:12.782488 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:12.782439    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-smj5h" podStartSLOduration=2.270353071 podStartE2EDuration="4.782422907s" totalImagesPullingTime="2.512069836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:12.781918489 +0000 UTC m=+41.730935961" watchObservedRunningTime="2026-07-15 13:07:12.782422907 +0000 UTC m=+41.731440375"
Jul 15 13:07:16.661971 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:16.661920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:16.662400 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:16.662081    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:16.662400 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:16.662145    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:24.662129812 +0000 UTC m=+53.611147262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:24.716849 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:24.716794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:24.717569 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:24.716977    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:24.717569 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:24.717071    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:07:40.717050259 +0000 UTC m=+69.666067724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:34.744600 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:34.744573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdmmc"
Jul 15 13:07:37.205818 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.205768    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:37.208344 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.208325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 13:07:37.218780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.218763    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 13:07:37.230394 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.230370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqt7\" (UniqueName: \"kubernetes.io/projected/27efc05c-2a46-4b31-96fe-6775b4224f47-kube-api-access-hpqt7\") pod \"network-check-target-99bsw\" (UID: \"27efc05c-2a46-4b31-96fe-6775b4224f47\") " pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:37.306076 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.306040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:37.306076 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.306082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:07:37.307449 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.307430    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nr6v2\""
Jul 15 13:07:37.308071 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.308058    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 13:07:37.308373 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.308360    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 13:07:37.315166 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.315153    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:37.316334 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:37.316314    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:07:37.316436 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:37.316381    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:08:41.316361504 +0000 UTC m=+130.265378965 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : secret "metrics-daemon-secret" not found
Jul 15 13:07:37.318531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.318457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aea8d8b2-fea6-4098-ba33-99a22b7022a4-original-pull-secret\") pod \"global-pull-secret-syncer-rqjmp\" (UID: \"aea8d8b2-fea6-4098-ba33-99a22b7022a4\") " pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:37.436550 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.436521    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99bsw"]
Jul 15 13:07:37.440653 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:07:37.440621    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27efc05c_2a46_4b31_96fe_6775b4224f47.slice/crio-7185eae17c182c694c9a8ffa804cd15c2955129cec60fa7b523d31f83a9cf0ef WatchSource:0}: Error finding container 7185eae17c182c694c9a8ffa804cd15c2955129cec60fa7b523d31f83a9cf0ef: Status 404 returned error can't find the container with id 7185eae17c182c694c9a8ffa804cd15c2955129cec60fa7b523d31f83a9cf0ef
Jul 15 13:07:37.591394 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.591311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqjmp"
Jul 15 13:07:37.711334 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.711306    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqjmp"]
Jul 15 13:07:37.714106 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:07:37.714075    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea8d8b2_fea6_4098_ba33_99a22b7022a4.slice/crio-ff8ce3280ee04e2fe8f8e486f8e5edafbeb2c8b746f09783ff8a2029e9ba96db WatchSource:0}: Error finding container ff8ce3280ee04e2fe8f8e486f8e5edafbeb2c8b746f09783ff8a2029e9ba96db: Status 404 returned error can't find the container with id ff8ce3280ee04e2fe8f8e486f8e5edafbeb2c8b746f09783ff8a2029e9ba96db
Jul 15 13:07:37.820633 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.820595    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqjmp" event={"ID":"aea8d8b2-fea6-4098-ba33-99a22b7022a4","Type":"ContainerStarted","Data":"ff8ce3280ee04e2fe8f8e486f8e5edafbeb2c8b746f09783ff8a2029e9ba96db"}
Jul 15 13:07:37.821684 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:37.821662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99bsw" event={"ID":"27efc05c-2a46-4b31-96fe-6775b4224f47","Type":"ContainerStarted","Data":"7185eae17c182c694c9a8ffa804cd15c2955129cec60fa7b523d31f83a9cf0ef"}
Jul 15 13:07:40.735385 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:40.735337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:07:40.735864 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:40.735514    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:07:40.735864 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:07:40.735601    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:08:12.735578166 +0000 UTC m=+101.684595629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:07:40.832713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:40.832625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99bsw" event={"ID":"27efc05c-2a46-4b31-96fe-6775b4224f47","Type":"ContainerStarted","Data":"f906770874ad3d3b6df11c8ce9e3474dd86e2de5d39841c4b772767df1474bbc"}
Jul 15 13:07:40.832713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:40.832715    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:07:40.849104 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:40.849055    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99bsw" podStartSLOduration=66.907835242 podStartE2EDuration="1m9.849040007s" totalImagesPullingTime="2.941204765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:40.848408269 +0000 UTC m=+69.797425743" watchObservedRunningTime="2026-07-15 13:07:40.849040007 +0000 UTC m=+69.798057477"
Jul 15 13:07:42.838889 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:42.838850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqjmp" event={"ID":"aea8d8b2-fea6-4098-ba33-99a22b7022a4","Type":"ContainerStarted","Data":"dc3044b262532fd0fa4f25d19481db9c91e078ee1f2f3c2ecbbaccd5785e8ec8"}
Jul 15 13:07:42.857087 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:07:42.857031    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rqjmp" podStartSLOduration=67.371655889 podStartE2EDuration="1m11.857010079s" totalImagesPullingTime="4.48535419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:07:42.854996164 +0000 UTC m=+71.804013635" watchObservedRunningTime="2026-07-15 13:07:42.857010079 +0000 UTC m=+71.806027551"
Jul 15 13:08:11.837326 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:08:11.837289    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99bsw"
Jul 15 13:08:12.758798 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:08:12.758747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:08:12.759004 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:08:12.758920    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:08:12.759074 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:08:12.759015    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:09:16.758993456 +0000 UTC m=+165.708010918 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:08:41.346455 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:08:41.346394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:08:41.346914 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:08:41.346555    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:08:41.346914 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:08:41.346649    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:43.346631123 +0000 UTC m=+252.295648584 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : secret "metrics-daemon-secret" not found
Jul 15 13:09:11.909583 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:09:11.909531    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lmkbx" podUID="9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1"
Jul 15 13:09:12.051968 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:09:12.051937    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:09:13.599016 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:09:13.598971    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:09:16.789563 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:09:16.789521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:09:16.789952 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:09:16.789634    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:09:16.789952 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:09:16.789686    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls podName:9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:18.789671627 +0000 UTC m=+287.738689076 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls") pod "dns-default-lmkbx" (UID: "9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1") : secret "dns-default-metrics-tls" not found
Jul 15 13:09:26.579173 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:09:26.579083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:10:27.178103 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.178072    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"]
Jul 15 13:10:27.179842 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.179826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"
Jul 15 13:10:27.182151 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.182125    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rz2pp\""
Jul 15 13:10:27.186334 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.186311    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"]
Jul 15 13:10:27.188228 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.188213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.192243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.192221    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 13:10:27.192371 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.192221    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r9ftt\""
Jul 15 13:10:27.192371 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.192289    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 13:10:27.192371 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.192305    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 13:10:27.192371 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.192289    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 13:10:27.220526 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.220495    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"]
Jul 15 13:10:27.240284 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.240240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"]
Jul 15 13:10:27.263961 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.263932    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d45hq\" (UniqueName: \"kubernetes.io/projected/6619589a-6871-41f1-a3bb-278fd395c762-kube-api-access-d45hq\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.264129 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.263975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrw2\" (UniqueName: \"kubernetes.io/projected/25aff18f-ec15-465b-81e3-a0fe0bdf6281-kube-api-access-sgrw2\") pod \"network-check-source-869dcfcdcd-knnp9\" (UID: \"25aff18f-ec15-465b-81e3-a0fe0bdf6281\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"
Jul 15 13:10:27.264129 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.263995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.264129 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.264042    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6619589a-6871-41f1-a3bb-278fd395c762-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.276491 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.276455    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q94x6"]
Jul 15 13:10:27.278344 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.278326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.281209 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.281189    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 13:10:27.281337 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.281190    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 13:10:27.281672 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.281651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-df4gf\""
Jul 15 13:10:27.288259 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.288233    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-bm7rt"]
Jul 15 13:10:27.289794 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.289776    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"]
Jul 15 13:10:27.289926 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.289910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.291325 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.291306    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-kh7k7"]
Jul 15 13:10:27.291451 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.291434    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.293075 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.293056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.295371 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.295356    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 13:10:27.296505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296485    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 13:10:27.296601 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296562    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ckwqv\""
Jul 15 13:10:27.296666 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296537    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 13:10:27.296666 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296531    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:10:27.296866 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296848    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 13:10:27.296866 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296864    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 13:10:27.297015 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296884    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 13:10:27.297015 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296972    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 13:10:27.297015 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.296986    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lcs9j\""
Jul 15 13:10:27.297227 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.297213    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 13:10:27.297227 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.297225    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kgmfq\""
Jul 15 13:10:27.297372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.297231    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 13:10:27.297372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.297229    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:10:27.299914 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.299896    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 13:10:27.304569 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.304539    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q94x6"]
Jul 15 13:10:27.308774 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.308748    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 13:10:27.312658 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.312638    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 13:10:27.317793 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.317707    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"]
Jul 15 13:10:27.318486 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.318468    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-kh7k7"]
Jul 15 13:10:27.321710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.321688    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-bm7rt"]
Jul 15 13:10:27.364952 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.364916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998dabda-e2bf-479e-96d2-c64054271cd4-serving-cert\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.365163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.364968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bb1ea25-0aaa-41c0-9771-6674e12397bb-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.365163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-config\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.365163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbce2ac0-78c6-4dc2-bb4e-59535131e713-tmp\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.365163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrw2\" (UniqueName: \"kubernetes.io/projected/25aff18f-ec15-465b-81e3-a0fe0bdf6281-kube-api-access-sgrw2\") pod \"network-check-source-869dcfcdcd-knnp9\" (UID: \"25aff18f-ec15-465b-81e3-a0fe0bdf6281\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"
Jul 15 13:10:27.365163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.365163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbce2ac0-78c6-4dc2-bb4e-59535131e713-serving-cert\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6619589a-6871-41f1-a3bb-278fd395c762-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998dabda-e2bf-479e-96d2-c64054271cd4-config\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbce2ac0-78c6-4dc2-bb4e-59535131e713-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/998dabda-e2bf-479e-96d2-c64054271cd4-trusted-ca\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/998dabda-e2bf-479e-96d2-c64054271cd4-kube-api-access-4pwvr\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdfn\" (UniqueName: \"kubernetes.io/projected/fbce2ac0-78c6-4dc2-bb4e-59535131e713-kube-api-access-cxdfn\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbce2ac0-78c6-4dc2-bb4e-59535131e713-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.365505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fbce2ac0-78c6-4dc2-bb4e-59535131e713-snapshots\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.366016 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.365513    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:27.366016 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d45hq\" (UniqueName: \"kubernetes.io/projected/6619589a-6871-41f1-a3bb-278fd395c762-kube-api-access-d45hq\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.366016 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.365592    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls podName:6619589a-6871-41f1-a3bb-278fd395c762 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:27.865573707 +0000 UTC m=+236.814591159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wff76" (UID: "6619589a-6871-41f1-a3bb-278fd395c762") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:27.366016 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmxg\" (UniqueName: \"kubernetes.io/projected/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-kube-api-access-ctmxg\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.366016 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.365960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6619589a-6871-41f1-a3bb-278fd395c762-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.381464 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.381427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrw2\" (UniqueName: \"kubernetes.io/projected/25aff18f-ec15-465b-81e3-a0fe0bdf6281-kube-api-access-sgrw2\") pod \"network-check-source-869dcfcdcd-knnp9\" (UID: \"25aff18f-ec15-465b-81e3-a0fe0bdf6281\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"
Jul 15 13:10:27.382403 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.382380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d45hq\" (UniqueName: \"kubernetes.io/projected/6619589a-6871-41f1-a3bb-278fd395c762-kube-api-access-d45hq\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.466055 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.465952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbce2ac0-78c6-4dc2-bb4e-59535131e713-tmp\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466055 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbce2ac0-78c6-4dc2-bb4e-59535131e713-serving-cert\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998dabda-e2bf-479e-96d2-c64054271cd4-config\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.466235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbce2ac0-78c6-4dc2-bb4e-59535131e713-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/998dabda-e2bf-479e-96d2-c64054271cd4-trusted-ca\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.466417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/998dabda-e2bf-479e-96d2-c64054271cd4-kube-api-access-4pwvr\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.466417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdfn\" (UniqueName: \"kubernetes.io/projected/fbce2ac0-78c6-4dc2-bb4e-59535131e713-kube-api-access-cxdfn\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.466417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbce2ac0-78c6-4dc2-bb4e-59535131e713-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.466417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fbce2ac0-78c6-4dc2-bb4e-59535131e713-snapshots\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbce2ac0-78c6-4dc2-bb4e-59535131e713-tmp\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmxg\" (UniqueName: \"kubernetes.io/projected/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-kube-api-access-ctmxg\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.466710 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.466643    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:10:27.466710 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.466699    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert podName:4bb1ea25-0aaa-41c0-9771-6674e12397bb nodeName:}" failed. No retries permitted until 2026-07-15 13:10:27.966682494 +0000 UTC m=+236.915699966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q94x6" (UID: "4bb1ea25-0aaa-41c0-9771-6674e12397bb") : secret "networking-console-plugin-cert" not found
Jul 15 13:10:27.466925 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbce2ac0-78c6-4dc2-bb4e-59535131e713-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.466925 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.466918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998dabda-e2bf-479e-96d2-c64054271cd4-config\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.467054 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998dabda-e2bf-479e-96d2-c64054271cd4-serving-cert\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.467114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bb1ea25-0aaa-41c0-9771-6674e12397bb-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.467114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-config\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.467213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/998dabda-e2bf-479e-96d2-c64054271cd4-trusted-ca\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.467213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbce2ac0-78c6-4dc2-bb4e-59535131e713-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.467368 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467345    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fbce2ac0-78c6-4dc2-bb4e-59535131e713-snapshots\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.467741 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-config\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.467838 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.467782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bb1ea25-0aaa-41c0-9771-6674e12397bb-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.468711 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.468684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbce2ac0-78c6-4dc2-bb4e-59535131e713-serving-cert\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.469196 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.469182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998dabda-e2bf-479e-96d2-c64054271cd4-serving-cert\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.469378 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.469360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.477471 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.477437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmxg\" (UniqueName: \"kubernetes.io/projected/2ad5b723-9fed-4b14-8aa8-8d8f84e7067c-kube-api-access-ctmxg\") pod \"service-ca-operator-7695fc6c8c-lsb9g\" (UID: \"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.477683 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.477664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdfn\" (UniqueName: \"kubernetes.io/projected/fbce2ac0-78c6-4dc2-bb4e-59535131e713-kube-api-access-cxdfn\") pod \"insights-operator-68d9dd94cf-bm7rt\" (UID: \"fbce2ac0-78c6-4dc2-bb4e-59535131e713\") " pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.478208 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.478187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/998dabda-e2bf-479e-96d2-c64054271cd4-kube-api-access-4pwvr\") pod \"console-operator-7866497494-kh7k7\" (UID: \"998dabda-e2bf-479e-96d2-c64054271cd4\") " pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.488178 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.488155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"
Jul 15 13:10:27.599690 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.599662    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt"
Jul 15 13:10:27.606447 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.606421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:27.612521 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.612496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"
Jul 15 13:10:27.616169 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.616145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9"]
Jul 15 13:10:27.620130 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:27.620095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25aff18f_ec15_465b_81e3_a0fe0bdf6281.slice/crio-45c27f5e0daf04958d82b5e9782c1f89433105ac592e5de986b2239a23a72c6f WatchSource:0}: Error finding container 45c27f5e0daf04958d82b5e9782c1f89433105ac592e5de986b2239a23a72c6f: Status 404 returned error can't find the container with id 45c27f5e0daf04958d82b5e9782c1f89433105ac592e5de986b2239a23a72c6f
Jul 15 13:10:27.755329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.755298    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-bm7rt"]
Jul 15 13:10:27.758879 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:27.758850    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbce2ac0_78c6_4dc2_bb4e_59535131e713.slice/crio-2ba65b97f7e66a4c8c577be81e1cf4adb92fdacf9158dab6c0a0b8b4872e739b WatchSource:0}: Error finding container 2ba65b97f7e66a4c8c577be81e1cf4adb92fdacf9158dab6c0a0b8b4872e739b: Status 404 returned error can't find the container with id 2ba65b97f7e66a4c8c577be81e1cf4adb92fdacf9158dab6c0a0b8b4872e739b
Jul 15 13:10:27.870101 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.870057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:27.870269 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.870203    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:27.870269 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.870270    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls podName:6619589a-6871-41f1-a3bb-278fd395c762 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:28.870254081 +0000 UTC m=+237.819271531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wff76" (UID: "6619589a-6871-41f1-a3bb-278fd395c762") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:27.970945 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.970874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:27.971084 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.971026    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:10:27.971123 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:27.971091    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert podName:4bb1ea25-0aaa-41c0-9771-6674e12397bb nodeName:}" failed. No retries permitted until 2026-07-15 13:10:28.971075072 +0000 UTC m=+237.920092521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q94x6" (UID: "4bb1ea25-0aaa-41c0-9771-6674e12397bb") : secret "networking-console-plugin-cert" not found
Jul 15 13:10:27.977887 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.977855    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g"]
Jul 15 13:10:27.981235 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:27.981074    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad5b723_9fed_4b14_8aa8_8d8f84e7067c.slice/crio-9a473acc4cbb784eeea482b7e8c8fbc7ff2b8d630e67192f6ec5a360e2f7c660 WatchSource:0}: Error finding container 9a473acc4cbb784eeea482b7e8c8fbc7ff2b8d630e67192f6ec5a360e2f7c660: Status 404 returned error can't find the container with id 9a473acc4cbb784eeea482b7e8c8fbc7ff2b8d630e67192f6ec5a360e2f7c660
Jul 15 13:10:27.981979 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:27.981944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-kh7k7"]
Jul 15 13:10:27.984860 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:27.984840    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998dabda_e2bf_479e_96d2_c64054271cd4.slice/crio-5767de6608e0836b31e9aa38fba7f0d769d6b361d46efc0f0573bb281ba514e3 WatchSource:0}: Error finding container 5767de6608e0836b31e9aa38fba7f0d769d6b361d46efc0f0573bb281ba514e3: Status 404 returned error can't find the container with id 5767de6608e0836b31e9aa38fba7f0d769d6b361d46efc0f0573bb281ba514e3
Jul 15 13:10:28.235182 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.235076    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9" event={"ID":"25aff18f-ec15-465b-81e3-a0fe0bdf6281","Type":"ContainerStarted","Data":"ab1d58e17701c623bf75091d52810ce19686aac314ba9da144c8c35b3ff4b109"}
Jul 15 13:10:28.235182 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.235136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9" event={"ID":"25aff18f-ec15-465b-81e3-a0fe0bdf6281","Type":"ContainerStarted","Data":"45c27f5e0daf04958d82b5e9782c1f89433105ac592e5de986b2239a23a72c6f"}
Jul 15 13:10:28.236307 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.236265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kh7k7" event={"ID":"998dabda-e2bf-479e-96d2-c64054271cd4","Type":"ContainerStarted","Data":"5767de6608e0836b31e9aa38fba7f0d769d6b361d46efc0f0573bb281ba514e3"}
Jul 15 13:10:28.237325 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.237294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt" event={"ID":"fbce2ac0-78c6-4dc2-bb4e-59535131e713","Type":"ContainerStarted","Data":"2ba65b97f7e66a4c8c577be81e1cf4adb92fdacf9158dab6c0a0b8b4872e739b"}
Jul 15 13:10:28.238298 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.238260    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g" event={"ID":"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c","Type":"ContainerStarted","Data":"9a473acc4cbb784eeea482b7e8c8fbc7ff2b8d630e67192f6ec5a360e2f7c660"}
Jul 15 13:10:28.252513 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.252460    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-knnp9" podStartSLOduration=1.252444312 podStartE2EDuration="1.252444312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:28.251453458 +0000 UTC m=+237.200470932" watchObservedRunningTime="2026-07-15 13:10:28.252444312 +0000 UTC m=+237.201461814"
Jul 15 13:10:28.879818 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.879542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:28.879818 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:28.879771    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:28.880060 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:28.879839    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls podName:6619589a-6871-41f1-a3bb-278fd395c762 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:30.879819689 +0000 UTC m=+239.828837144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wff76" (UID: "6619589a-6871-41f1-a3bb-278fd395c762") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:28.980564 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:28.980522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:28.980753 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:28.980696    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:10:28.980876 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:28.980781    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert podName:4bb1ea25-0aaa-41c0-9771-6674e12397bb nodeName:}" failed. No retries permitted until 2026-07-15 13:10:30.980758719 +0000 UTC m=+239.929776181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q94x6" (UID: "4bb1ea25-0aaa-41c0-9771-6674e12397bb") : secret "networking-console-plugin-cert" not found
Jul 15 13:10:30.661481 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.661441    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"]
Jul 15 13:10:30.666132 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.666109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"
Jul 15 13:10:30.668833 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.668804    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 13:10:30.668994 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.668974    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 13:10:30.669958 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.669940    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8mlff\""
Jul 15 13:10:30.676478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.676412    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"]
Jul 15 13:10:30.795045 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.795015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/df9972db-aee6-49cb-ba54-952ec804d30a-kube-api-access-jdvqw\") pod \"migrator-7f59b54f6c-sj6nt\" (UID: \"df9972db-aee6-49cb-ba54-952ec804d30a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"
Jul 15 13:10:30.896402 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.896376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:30.896511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.896415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/df9972db-aee6-49cb-ba54-952ec804d30a-kube-api-access-jdvqw\") pod \"migrator-7f59b54f6c-sj6nt\" (UID: \"df9972db-aee6-49cb-ba54-952ec804d30a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"
Jul 15 13:10:30.896572 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:30.896544    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:30.896637 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:30.896624    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls podName:6619589a-6871-41f1-a3bb-278fd395c762 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:34.896603678 +0000 UTC m=+243.845621133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wff76" (UID: "6619589a-6871-41f1-a3bb-278fd395c762") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:30.907718 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.907695    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/df9972db-aee6-49cb-ba54-952ec804d30a-kube-api-access-jdvqw\") pod \"migrator-7f59b54f6c-sj6nt\" (UID: \"df9972db-aee6-49cb-ba54-952ec804d30a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"
Jul 15 13:10:30.977037 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.976998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"
Jul 15 13:10:30.997290 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:30.997246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:30.997455 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:30.997439    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:10:30.997541 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:30.997529    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert podName:4bb1ea25-0aaa-41c0-9771-6674e12397bb nodeName:}" failed. No retries permitted until 2026-07-15 13:10:34.997501155 +0000 UTC m=+243.946518606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q94x6" (UID: "4bb1ea25-0aaa-41c0-9771-6674e12397bb") : secret "networking-console-plugin-cert" not found
Jul 15 13:10:31.113763 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.113735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt"]
Jul 15 13:10:31.116416 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:31.116390    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9972db_aee6_49cb_ba54_952ec804d30a.slice/crio-11efe663adc106a5c8108d5a6ae3fb3804cb6fd3e6dd26b3a718682ec4d407ce WatchSource:0}: Error finding container 11efe663adc106a5c8108d5a6ae3fb3804cb6fd3e6dd26b3a718682ec4d407ce: Status 404 returned error can't find the container with id 11efe663adc106a5c8108d5a6ae3fb3804cb6fd3e6dd26b3a718682ec4d407ce
Jul 15 13:10:31.255093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.255021    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/0.log"
Jul 15 13:10:31.255093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.255068    2561 generic.go:356] "Generic (PLEG): container finished" podID="998dabda-e2bf-479e-96d2-c64054271cd4" containerID="377f2ac388cf51170d57e16768571d13198c8dbdcf6d7d50bc835813522b62e9" exitCode=255
Jul 15 13:10:31.255339 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.255146    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kh7k7" event={"ID":"998dabda-e2bf-479e-96d2-c64054271cd4","Type":"ContainerDied","Data":"377f2ac388cf51170d57e16768571d13198c8dbdcf6d7d50bc835813522b62e9"}
Jul 15 13:10:31.255395 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.255380    2561 scope.go:117] "RemoveContainer" containerID="377f2ac388cf51170d57e16768571d13198c8dbdcf6d7d50bc835813522b62e9"
Jul 15 13:10:31.256949 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.256916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt" event={"ID":"fbce2ac0-78c6-4dc2-bb4e-59535131e713","Type":"ContainerStarted","Data":"dcf73c83d01286314db55eaefd5ca025d51c5e292363048b0d055fa453f52f16"}
Jul 15 13:10:31.258323 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.258247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt" event={"ID":"df9972db-aee6-49cb-ba54-952ec804d30a","Type":"ContainerStarted","Data":"11efe663adc106a5c8108d5a6ae3fb3804cb6fd3e6dd26b3a718682ec4d407ce"}
Jul 15 13:10:31.259853 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.259827    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g" event={"ID":"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c","Type":"ContainerStarted","Data":"0f2fcfbb164cfc6f06490e901b2b220c4a3e3837265d034c20131068ceb6d747"}
Jul 15 13:10:31.291388 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.291333    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt" podStartSLOduration=1.309218646 podStartE2EDuration="4.291315465s" totalImagesPullingTime="2.982096819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:31.290831446 +0000 UTC m=+240.239848917" watchObservedRunningTime="2026-07-15 13:10:31.291315465 +0000 UTC m=+240.240332936"
Jul 15 13:10:31.309436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.309385    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g" podStartSLOduration=1.546513813 podStartE2EDuration="4.309368465s" totalImagesPullingTime="2.762854652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:31.30842969 +0000 UTC m=+240.257447162" watchObservedRunningTime="2026-07-15 13:10:31.309368465 +0000 UTC m=+240.258385930"
Jul 15 13:10:31.832977 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.832895    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-slg62"]
Jul 15 13:10:31.837093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.837054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:31.840410 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.840148    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 13:10:31.840410 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.840172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m9psk\""
Jul 15 13:10:31.840610 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.840534    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 13:10:31.848700 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.848674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-slg62"]
Jul 15 13:10:31.905083 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.905054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cvw\" (UniqueName: \"kubernetes.io/projected/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-api-access-c5cvw\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:31.905261 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.905105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:31.905261 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.905179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:31.905261 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.905232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45fff1a8-86c1-4ba7-b982-71a86a255235-crio-socket\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:31.905450 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:31.905304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45fff1a8-86c1-4ba7-b982-71a86a255235-data-volume\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.006568 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.006532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.006568 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.006575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.006801 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.006607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45fff1a8-86c1-4ba7-b982-71a86a255235-crio-socket\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.006801 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.006679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45fff1a8-86c1-4ba7-b982-71a86a255235-crio-socket\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.006801 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.006686    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:10:32.006801 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.006719    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:32.006801 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.006764    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:32.506744713 +0000 UTC m=+241.455762186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : configmap "kube-rbac-proxy" not found
Jul 15 13:10:32.007052 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.006820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45fff1a8-86c1-4ba7-b982-71a86a255235-data-volume\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.007052 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.006848    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:32.506832248 +0000 UTC m=+241.455849700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:32.007052 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.006900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cvw\" (UniqueName: \"kubernetes.io/projected/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-api-access-c5cvw\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.007214 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.007152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45fff1a8-86c1-4ba7-b982-71a86a255235-data-volume\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.015138 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.015108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cvw\" (UniqueName: \"kubernetes.io/projected/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-api-access-c5cvw\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.264748 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.264704    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:10:32.265216 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.265196    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/0.log"
Jul 15 13:10:32.265313 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.265247    2561 generic.go:356] "Generic (PLEG): container finished" podID="998dabda-e2bf-479e-96d2-c64054271cd4" containerID="a4d5cc867400b03a6d45d984f4b2d5768f6b374207a48aac32a64f74c3a49a95" exitCode=255
Jul 15 13:10:32.265372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.265334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kh7k7" event={"ID":"998dabda-e2bf-479e-96d2-c64054271cd4","Type":"ContainerDied","Data":"a4d5cc867400b03a6d45d984f4b2d5768f6b374207a48aac32a64f74c3a49a95"}
Jul 15 13:10:32.265458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.265411    2561 scope.go:117] "RemoveContainer" containerID="377f2ac388cf51170d57e16768571d13198c8dbdcf6d7d50bc835813522b62e9"
Jul 15 13:10:32.265615 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.265592    2561 scope.go:117] "RemoveContainer" containerID="a4d5cc867400b03a6d45d984f4b2d5768f6b374207a48aac32a64f74c3a49a95"
Jul 15 13:10:32.265799 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.265777    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-kh7k7_openshift-console-operator(998dabda-e2bf-479e-96d2-c64054271cd4)\"" pod="openshift-console-operator/console-operator-7866497494-kh7k7" podUID="998dabda-e2bf-479e-96d2-c64054271cd4"
Jul 15 13:10:32.512365 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.512320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.512547 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:32.512386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:32.512547 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.512484    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:32.512547 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.512491    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:10:32.512645 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.512549    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:33.51253236 +0000 UTC m=+242.461549812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:32.512645 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:32.512563    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:33.512556759 +0000 UTC m=+242.461574207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : configmap "kube-rbac-proxy" not found
Jul 15 13:10:33.270446 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.270419    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:10:33.270864 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.270816    2561 scope.go:117] "RemoveContainer" containerID="a4d5cc867400b03a6d45d984f4b2d5768f6b374207a48aac32a64f74c3a49a95"
Jul 15 13:10:33.270990 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:33.270970    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-kh7k7_openshift-console-operator(998dabda-e2bf-479e-96d2-c64054271cd4)\"" pod="openshift-console-operator/console-operator-7866497494-kh7k7" podUID="998dabda-e2bf-479e-96d2-c64054271cd4"
Jul 15 13:10:33.272068 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.272039    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt" event={"ID":"df9972db-aee6-49cb-ba54-952ec804d30a","Type":"ContainerStarted","Data":"7c610e4fc461b8a689bc1ea19843f33cc89ee608f49e2d6ae4484b0819b4d6bf"}
Jul 15 13:10:33.272163 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.272112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt" event={"ID":"df9972db-aee6-49cb-ba54-952ec804d30a","Type":"ContainerStarted","Data":"a49daaee5998cdf24c95b9941d54f44b5247c664ecb74bb3108918683d9cd0f9"}
Jul 15 13:10:33.312572 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.312521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sj6nt" podStartSLOduration=2.139820914 podStartE2EDuration="3.312504584s" totalImagesPullingTime="1.17268367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:33.311886565 +0000 UTC m=+242.260904054" watchObservedRunningTime="2026-07-15 13:10:33.312504584 +0000 UTC m=+242.261522055"
Jul 15 13:10:33.520689 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.520590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:33.520689 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:33.520633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:33.520908 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:33.520731    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:10:33.520908 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:33.520759    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:33.520908 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:33.520796    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:35.520782166 +0000 UTC m=+244.469799615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : configmap "kube-rbac-proxy" not found
Jul 15 13:10:33.520908 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:33.520823    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:35.520805789 +0000 UTC m=+244.469823240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:34.613080 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:34.613045    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8567_29d473db-3c07-45ba-b602-7af6780e7e88/dns-node-resolver/0.log"
Jul 15 13:10:34.931739 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:34.931710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:34.931883 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:34.931850    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:34.931934 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:34.931922    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls podName:6619589a-6871-41f1-a3bb-278fd395c762 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:42.931905437 +0000 UTC m=+251.880922899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wff76" (UID: "6619589a-6871-41f1-a3bb-278fd395c762") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:35.033116 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:35.033083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:35.033261 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:35.033235    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:10:35.033321 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:35.033316    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert podName:4bb1ea25-0aaa-41c0-9771-6674e12397bb nodeName:}" failed. No retries permitted until 2026-07-15 13:10:43.033299263 +0000 UTC m=+251.982316714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q94x6" (UID: "4bb1ea25-0aaa-41c0-9771-6674e12397bb") : secret "networking-console-plugin-cert" not found
Jul 15 13:10:35.413894 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:35.413815    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ggpgm_c08f3d1c-a2d6-4668-91bd-7072d254a978/node-ca/0.log"
Jul 15 13:10:35.536541 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:35.536508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:35.536724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:35.536548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:35.536724 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:35.536625    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:10:35.536724 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:35.536665    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:35.536724 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:35.536678    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:39.536659624 +0000 UTC m=+248.485677073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : configmap "kube-rbac-proxy" not found
Jul 15 13:10:35.536724 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:35.536714    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:39.536700628 +0000 UTC m=+248.485718077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:36.613073 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:36.613024    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smj5h_ec15faff-43dc-4453-b2e5-025a8fa7fd50/serve-healthcheck-canary/0.log"
Jul 15 13:10:36.814241 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:36.814216    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sj6nt_df9972db-aee6-49cb-ba54-952ec804d30a/migrator/0.log"
Jul 15 13:10:37.012959 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:37.012934    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sj6nt_df9972db-aee6-49cb-ba54-952ec804d30a/graceful-termination/0.log"
Jul 15 13:10:37.606712 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:37.606680    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:37.606882 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:37.606730    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:37.607102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:37.607087    2561 scope.go:117] "RemoveContainer" containerID="a4d5cc867400b03a6d45d984f4b2d5768f6b374207a48aac32a64f74c3a49a95"
Jul 15 13:10:37.607296 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:37.607252    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-kh7k7_openshift-console-operator(998dabda-e2bf-479e-96d2-c64054271cd4)\"" pod="openshift-console-operator/console-operator-7866497494-kh7k7" podUID="998dabda-e2bf-479e-96d2-c64054271cd4"
Jul 15 13:10:39.571347 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:39.571308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:39.571820 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:39.571359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:39.571820 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:39.571443    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:10:39.571820 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:39.571460    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:39.571820 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:39.571509    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:47.571494607 +0000 UTC m=+256.520512080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : configmap "kube-rbac-proxy" not found
Jul 15 13:10:39.571820 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:39.571525    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:47.571519298 +0000 UTC m=+256.520536746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:42.999269 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:42.999228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:42.999787 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:42.999412    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:42.999787 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:42.999499    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls podName:6619589a-6871-41f1-a3bb-278fd395c762 nodeName:}" failed. No retries permitted until 2026-07-15 13:10:58.999479164 +0000 UTC m=+267.948496613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wff76" (UID: "6619589a-6871-41f1-a3bb-278fd395c762") : secret "cluster-monitoring-operator-tls" not found
Jul 15 13:10:43.100303 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:43.100237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:43.100471 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:43.100392    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 13:10:43.100471 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:43.100457    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert podName:4bb1ea25-0aaa-41c0-9771-6674e12397bb nodeName:}" failed. No retries permitted until 2026-07-15 13:10:59.100441934 +0000 UTC m=+268.049459386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q94x6" (UID: "4bb1ea25-0aaa-41c0-9771-6674e12397bb") : secret "networking-console-plugin-cert" not found
Jul 15 13:10:43.403129 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:43.403041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:10:43.403315 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:43.403203    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:10:43.403315 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:43.403266    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs podName:f02e7e8e-7628-4291-bcc6-203da9da2216 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:45.403249508 +0000 UTC m=+374.352266964 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs") pod "network-metrics-daemon-2fj7r" (UID: "f02e7e8e-7628-4291-bcc6-203da9da2216") : secret "metrics-daemon-secret" not found
Jul 15 13:10:47.638515 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:47.638472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:47.638515 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:47.638518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:47.638956 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:47.638617    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:47.638956 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:10:47.638683    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls podName:45fff1a8-86c1-4ba7-b982-71a86a255235 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:03.638664636 +0000 UTC m=+272.587682088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls") pod "insights-runtime-extractor-slg62" (UID: "45fff1a8-86c1-4ba7-b982-71a86a255235") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:10:47.639035 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:47.638998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45fff1a8-86c1-4ba7-b982-71a86a255235-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:10:50.579355 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:50.579325    2561 scope.go:117] "RemoveContainer" containerID="a4d5cc867400b03a6d45d984f4b2d5768f6b374207a48aac32a64f74c3a49a95"
Jul 15 13:10:51.326473 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:51.326444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:10:51.326640 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:51.326489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kh7k7" event={"ID":"998dabda-e2bf-479e-96d2-c64054271cd4","Type":"ContainerStarted","Data":"0e21fc3aa3acefac789a6366e4d6d3096c1e45be1d54a3ebd9db2db66d10d60b"}
Jul 15 13:10:51.326783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:51.326760    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:51.331309 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:51.331285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-kh7k7"
Jul 15 13:10:51.345712 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:51.345675    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-kh7k7" podStartSLOduration=21.583416682 podStartE2EDuration="24.345661206s" totalImagesPullingTime="2.762244524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:51.344575871 +0000 UTC m=+260.293593335" watchObservedRunningTime="2026-07-15 13:10:51.345661206 +0000 UTC m=+260.294678676"
Jul 15 13:10:56.235137 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.235105    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-xnbkl"]
Jul 15 13:10:56.238344 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.238321    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"]
Jul 15 13:10:56.238478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.238450    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:10:56.240512 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.240491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.241114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.241095    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 13:10:56.241207 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.241184    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 13:10:56.241268 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.241184    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sx8tb\""
Jul 15 13:10:56.243032 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.243016    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 13:10:56.243214 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.243202    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 13:10:56.243258 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.243228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j4np7\""
Jul 15 13:10:56.243610 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.243597    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 13:10:56.251093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.251072    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 13:10:56.253538 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.253515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xnbkl"]
Jul 15 13:10:56.259775 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.259753    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"]
Jul 15 13:10:56.403111 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-registry-tls\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403302 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1222dc-5056-43b0-80a6-3827ac08d6e3-ca-trust-extracted\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403302 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1222dc-5056-43b0-80a6-3827ac08d6e3-trusted-ca\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403302 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1222dc-5056-43b0-80a6-3827ac08d6e3-image-registry-private-configuration\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gsck\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-kube-api-access-9gsck\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1222dc-5056-43b0-80a6-3827ac08d6e3-installation-pull-secrets\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqt44\" (UniqueName: \"kubernetes.io/projected/b122ec39-2a64-43a4-8a44-946ce0df4050-kube-api-access-rqt44\") pod \"downloads-68c9cbb497-xnbkl\" (UID: \"b122ec39-2a64-43a4-8a44-946ce0df4050\") " pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:10:56.403435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-bound-sa-token\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.403435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.403427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1222dc-5056-43b0-80a6-3827ac08d6e3-registry-certificates\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsck\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-kube-api-access-9gsck\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1222dc-5056-43b0-80a6-3827ac08d6e3-installation-pull-secrets\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqt44\" (UniqueName: \"kubernetes.io/projected/b122ec39-2a64-43a4-8a44-946ce0df4050-kube-api-access-rqt44\") pod \"downloads-68c9cbb497-xnbkl\" (UID: \"b122ec39-2a64-43a4-8a44-946ce0df4050\") " pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:10:56.504518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-bound-sa-token\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1222dc-5056-43b0-80a6-3827ac08d6e3-registry-certificates\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-registry-tls\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1222dc-5056-43b0-80a6-3827ac08d6e3-ca-trust-extracted\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1222dc-5056-43b0-80a6-3827ac08d6e3-trusted-ca\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1222dc-5056-43b0-80a6-3827ac08d6e3-image-registry-private-configuration\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.504968 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.504937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1222dc-5056-43b0-80a6-3827ac08d6e3-ca-trust-extracted\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.505143 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.505123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1222dc-5056-43b0-80a6-3827ac08d6e3-registry-certificates\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.505708 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.505681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1222dc-5056-43b0-80a6-3827ac08d6e3-trusted-ca\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.506929 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.506906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1222dc-5056-43b0-80a6-3827ac08d6e3-image-registry-private-configuration\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.507041 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.506941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1222dc-5056-43b0-80a6-3827ac08d6e3-installation-pull-secrets\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.507114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.507090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-registry-tls\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.516103 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.516072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gsck\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-kube-api-access-9gsck\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.517176 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.517147    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqt44\" (UniqueName: \"kubernetes.io/projected/b122ec39-2a64-43a4-8a44-946ce0df4050-kube-api-access-rqt44\") pod \"downloads-68c9cbb497-xnbkl\" (UID: \"b122ec39-2a64-43a4-8a44-946ce0df4050\") " pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:10:56.517756 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.517735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1222dc-5056-43b0-80a6-3827ac08d6e3-bound-sa-token\") pod \"image-registry-7ccdf4bf97-g5wd7\" (UID: \"6d1222dc-5056-43b0-80a6-3827ac08d6e3\") " pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.549806 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.549773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:10:56.555467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.555443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:56.690548 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.690520    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xnbkl"]
Jul 15 13:10:56.693309 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:56.693267    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb122ec39_2a64_43a4_8a44_946ce0df4050.slice/crio-842bcf11a1f1169bebbc2f55befebafbd729280fbbbcbf8df9970b5cf3a4b2c1 WatchSource:0}: Error finding container 842bcf11a1f1169bebbc2f55befebafbd729280fbbbcbf8df9970b5cf3a4b2c1: Status 404 returned error can't find the container with id 842bcf11a1f1169bebbc2f55befebafbd729280fbbbcbf8df9970b5cf3a4b2c1
Jul 15 13:10:56.709104 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:56.709076    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"]
Jul 15 13:10:56.713111 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:56.713090    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1222dc_5056_43b0_80a6_3827ac08d6e3.slice/crio-ecad8f4e55f145e9a304f0b728f33bf83c4e8b2a189ac9e69da2eb8f120b49ca WatchSource:0}: Error finding container ecad8f4e55f145e9a304f0b728f33bf83c4e8b2a189ac9e69da2eb8f120b49ca: Status 404 returned error can't find the container with id ecad8f4e55f145e9a304f0b728f33bf83c4e8b2a189ac9e69da2eb8f120b49ca
Jul 15 13:10:57.348139 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:57.348097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7" event={"ID":"6d1222dc-5056-43b0-80a6-3827ac08d6e3","Type":"ContainerStarted","Data":"9da2b5f7f52b1b872796f8c96ed4d7c6d1e48a457f9aa269187b2234110b9b70"}
Jul 15 13:10:57.348710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:57.348201    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:10:57.348710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:57.348231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7" event={"ID":"6d1222dc-5056-43b0-80a6-3827ac08d6e3","Type":"ContainerStarted","Data":"ecad8f4e55f145e9a304f0b728f33bf83c4e8b2a189ac9e69da2eb8f120b49ca"}
Jul 15 13:10:57.349405 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:57.349378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xnbkl" event={"ID":"b122ec39-2a64-43a4-8a44-946ce0df4050","Type":"ContainerStarted","Data":"842bcf11a1f1169bebbc2f55befebafbd729280fbbbcbf8df9970b5cf3a4b2c1"}
Jul 15 13:10:57.369159 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:57.369113    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7" podStartSLOduration=1.36909374 podStartE2EDuration="1.36909374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:10:57.367785896 +0000 UTC m=+266.316803371" watchObservedRunningTime="2026-07-15 13:10:57.36909374 +0000 UTC m=+266.318111212"
Jul 15 13:10:59.031449 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.031406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:59.034382 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.034351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6619589a-6871-41f1-a3bb-278fd395c762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wff76\" (UID: \"6619589a-6871-41f1-a3bb-278fd395c762\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:59.132656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.132619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:59.135221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.135191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bb1ea25-0aaa-41c0-9771-6674e12397bb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q94x6\" (UID: \"4bb1ea25-0aaa-41c0-9771-6674e12397bb\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:59.298592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.298514    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r9ftt\""
Jul 15 13:10:59.306844 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.306816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"
Jul 15 13:10:59.390101 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.390070    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-df4gf\""
Jul 15 13:10:59.398468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.398432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6"
Jul 15 13:10:59.460356 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.460309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76"]
Jul 15 13:10:59.463084 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:59.463057    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6619589a_6871_41f1_a3bb_278fd395c762.slice/crio-bb19b61315fbe6ccbff7fe62d0ce664acfc38c97977470d4e4ef6df1b66c30f1 WatchSource:0}: Error finding container bb19b61315fbe6ccbff7fe62d0ce664acfc38c97977470d4e4ef6df1b66c30f1: Status 404 returned error can't find the container with id bb19b61315fbe6ccbff7fe62d0ce664acfc38c97977470d4e4ef6df1b66c30f1
Jul 15 13:10:59.545101 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:10:59.545069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q94x6"]
Jul 15 13:10:59.549055 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:10:59.548988    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb1ea25_0aaa_41c0_9771_6674e12397bb.slice/crio-499f043f0340a25faa1f0c1ff76e7f3ffaa67f2c17603c645578082cd2e2db9d WatchSource:0}: Error finding container 499f043f0340a25faa1f0c1ff76e7f3ffaa67f2c17603c645578082cd2e2db9d: Status 404 returned error can't find the container with id 499f043f0340a25faa1f0c1ff76e7f3ffaa67f2c17603c645578082cd2e2db9d
Jul 15 13:11:00.362605 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:00.362568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76" event={"ID":"6619589a-6871-41f1-a3bb-278fd395c762","Type":"ContainerStarted","Data":"bb19b61315fbe6ccbff7fe62d0ce664acfc38c97977470d4e4ef6df1b66c30f1"}
Jul 15 13:11:00.363827 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:00.363800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6" event={"ID":"4bb1ea25-0aaa-41c0-9771-6674e12397bb","Type":"ContainerStarted","Data":"499f043f0340a25faa1f0c1ff76e7f3ffaa67f2c17603c645578082cd2e2db9d"}
Jul 15 13:11:01.370204 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:01.370155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76" event={"ID":"6619589a-6871-41f1-a3bb-278fd395c762","Type":"ContainerStarted","Data":"18ab799eb5bed3ba4193aac62031470a45ccb32b600a1aa722ed30df0770267f"}
Jul 15 13:11:01.390679 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:01.390500    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76" podStartSLOduration=32.593928034 podStartE2EDuration="34.390477887s" totalImagesPullingTime="1.796549853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:01.38912132 +0000 UTC m=+270.338138792" watchObservedRunningTime="2026-07-15 13:11:01.390477887 +0000 UTC m=+270.339495358"
Jul 15 13:11:02.258911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.258864    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb5b6c8c8-cb7w7"]
Jul 15 13:11:02.261777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.261747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.264441 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.264402    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 13:11:02.265599 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.265570    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 13:11:02.265713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.265606    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 13:11:02.265713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.265623    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 13:11:02.265713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.265633    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 13:11:02.265713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.265573    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f5tck\""
Jul 15 13:11:02.273467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.273411    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb5b6c8c8-cb7w7"]
Jul 15 13:11:02.362254 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.362217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5qzf\" (UniqueName: \"kubernetes.io/projected/335489bf-7f66-47f5-972b-14533a00dd4d-kube-api-access-b5qzf\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.362436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.362265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-console-config\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.362436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.362349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-oauth-serving-cert\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.362436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.362384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-serving-cert\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.362436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.362410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-oauth-config\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.362658 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.362441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-service-ca\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.463169 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.463121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5qzf\" (UniqueName: \"kubernetes.io/projected/335489bf-7f66-47f5-972b-14533a00dd4d-kube-api-access-b5qzf\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.463662 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.463266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-console-config\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.463662 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.463353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-oauth-serving-cert\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.463662 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.463393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-serving-cert\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.463662 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.463418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-oauth-config\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.463662 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.463453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-service-ca\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.464319 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.464293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-oauth-serving-cert\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.464571 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.464451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-service-ca\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.464949 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.464928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-console-config\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.466970 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.466943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-serving-cert\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.467232 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.467210    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-oauth-config\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.471994 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.471967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5qzf\" (UniqueName: \"kubernetes.io/projected/335489bf-7f66-47f5-972b-14533a00dd4d-kube-api-access-b5qzf\") pod \"console-6bb5b6c8c8-cb7w7\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") " pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.573333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.573235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:02.742128 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:02.742063    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb5b6c8c8-cb7w7"]
Jul 15 13:11:02.745111 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:02.745064    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335489bf_7f66_47f5_972b_14533a00dd4d.slice/crio-a06a1297444ea01f5c3ce219907b2b28d978c456a3155dde9f3bc2c076cc8dba WatchSource:0}: Error finding container a06a1297444ea01f5c3ce219907b2b28d978c456a3155dde9f3bc2c076cc8dba: Status 404 returned error can't find the container with id a06a1297444ea01f5c3ce219907b2b28d978c456a3155dde9f3bc2c076cc8dba
Jul 15 13:11:03.381236 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:03.381192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb5b6c8c8-cb7w7" event={"ID":"335489bf-7f66-47f5-972b-14533a00dd4d","Type":"ContainerStarted","Data":"a06a1297444ea01f5c3ce219907b2b28d978c456a3155dde9f3bc2c076cc8dba"}
Jul 15 13:11:03.671448 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:03.671409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:11:03.674180 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:03.674156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45fff1a8-86c1-4ba7-b982-71a86a255235-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-slg62\" (UID: \"45fff1a8-86c1-4ba7-b982-71a86a255235\") " pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:11:03.949998 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:03.949957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-slg62"
Jul 15 13:11:04.107794 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.107765    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-slg62"]
Jul 15 13:11:04.110794 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:04.110759    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fff1a8_86c1_4ba7_b982_71a86a255235.slice/crio-3661d871e48e425f35fbb1bb253a8fd888a10a2882ac22016c940a3dbe043106 WatchSource:0}: Error finding container 3661d871e48e425f35fbb1bb253a8fd888a10a2882ac22016c940a3dbe043106: Status 404 returned error can't find the container with id 3661d871e48e425f35fbb1bb253a8fd888a10a2882ac22016c940a3dbe043106
Jul 15 13:11:04.386735 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.386644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-slg62" event={"ID":"45fff1a8-86c1-4ba7-b982-71a86a255235","Type":"ContainerStarted","Data":"3661d871e48e425f35fbb1bb253a8fd888a10a2882ac22016c940a3dbe043106"}
Jul 15 13:11:04.388406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.388359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6" event={"ID":"4bb1ea25-0aaa-41c0-9771-6674e12397bb","Type":"ContainerStarted","Data":"b74d148e8ab9ad4fe40af48c730df13fe7862d45d1d3658a8aea51372b1b2afc"}
Jul 15 13:11:04.428968 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.428907    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-q94x6" podStartSLOduration=33.398650861 podStartE2EDuration="37.428886189s" totalImagesPullingTime="4.030235328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:04.424834998 +0000 UTC m=+273.373852468" watchObservedRunningTime="2026-07-15 13:11:04.428886189 +0000 UTC m=+273.377903661"
Jul 15 13:11:04.842567 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.842532    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-slm8h"]
Jul 15 13:11:04.845919 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.845895    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.849729 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.849700    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 13:11:04.849860 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.849738    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 13:11:04.849860 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.849700    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 13:11:04.849986 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.849700    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rgcpd\""
Jul 15 13:11:04.858361 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.858259    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-slm8h"]
Jul 15 13:11:04.881800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.881764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbmzw\" (UniqueName: \"kubernetes.io/projected/8aa924a8-2b91-49b8-977d-e74a08bab0e7-kube-api-access-hbmzw\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.881986 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.881814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa924a8-2b91-49b8-977d-e74a08bab0e7-metrics-client-ca\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.881986 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.881943    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.882117 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.882025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.983119 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.983080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.983303 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.983163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbmzw\" (UniqueName: \"kubernetes.io/projected/8aa924a8-2b91-49b8-977d-e74a08bab0e7-kube-api-access-hbmzw\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.983303 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.983192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa924a8-2b91-49b8-977d-e74a08bab0e7-metrics-client-ca\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.983303 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:11:04.983259    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 13:11:04.983487 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:11:04.983355    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-tls podName:8aa924a8-2b91-49b8-977d-e74a08bab0e7 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:05.483331609 +0000 UTC m=+274.432349061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-tls") pod "prometheus-operator-64785b6675-slm8h" (UID: "8aa924a8-2b91-49b8-977d-e74a08bab0e7") : secret "prometheus-operator-tls" not found
Jul 15 13:11:04.983487 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.983266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.984140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.984114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa924a8-2b91-49b8-977d-e74a08bab0e7-metrics-client-ca\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.986320 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.986267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:04.992250 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:04.992220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbmzw\" (UniqueName: \"kubernetes.io/projected/8aa924a8-2b91-49b8-977d-e74a08bab0e7-kube-api-access-hbmzw\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:05.488587 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:05.488544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:05.493751 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:05.493681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa924a8-2b91-49b8-977d-e74a08bab0e7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-slm8h\" (UID: \"8aa924a8-2b91-49b8-977d-e74a08bab0e7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:05.759684 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:05.759455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h"
Jul 15 13:11:15.052944 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:11:15.052898    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lmkbx" podUID="9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1"
Jul 15 13:11:15.434232 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:15.434192    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:11:16.529419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:16.529358    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-slm8h"]
Jul 15 13:11:16.560269 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:16.560214    2561 patch_prober.go:28] interesting pod/image-registry-7ccdf4bf97-g5wd7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:11:16.560419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:16.560268    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7" podUID="6d1222dc-5056-43b0-80a6-3827ac08d6e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:11:17.448312 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.447568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xnbkl" event={"ID":"b122ec39-2a64-43a4-8a44-946ce0df4050","Type":"ContainerStarted","Data":"ac4bedb9cf742737c0d4de44772d178efa30558ea201164cabc7a7a6c1fa2078"}
Jul 15 13:11:17.450645 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.448798    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:11:17.453392 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.453127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb5b6c8c8-cb7w7" event={"ID":"335489bf-7f66-47f5-972b-14533a00dd4d","Type":"ContainerStarted","Data":"9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b"}
Jul 15 13:11:17.456542 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.456513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-slg62" event={"ID":"45fff1a8-86c1-4ba7-b982-71a86a255235","Type":"ContainerStarted","Data":"1f4c5bbafa9cf7576e23fc9bd842c52f1fda3e1e56c8c9cef4f1994baaec7307"}
Jul 15 13:11:17.458473 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.458324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h" event={"ID":"8aa924a8-2b91-49b8-977d-e74a08bab0e7","Type":"ContainerStarted","Data":"9a9bfc741256071b6a0be7b4f7ee891383dbaecf9de4ebb7d508700ebaff8f65"}
Jul 15 13:11:17.459424 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.459379    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-xnbkl"
Jul 15 13:11:17.478642 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.478552    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-xnbkl" podStartSLOduration=1.788200905 podStartE2EDuration="21.478533009s" totalImagesPullingTime="19.690332104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:17.470492716 +0000 UTC m=+286.419510236" watchObservedRunningTime="2026-07-15 13:11:17.478533009 +0000 UTC m=+286.427550481"
Jul 15 13:11:17.516809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:17.516645    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bb5b6c8c8-cb7w7" podStartSLOduration=2.207286747 podStartE2EDuration="15.516621589s" totalImagesPullingTime="13.309334842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:17.497387204 +0000 UTC m=+286.446404676" watchObservedRunningTime="2026-07-15 13:11:17.516621589 +0000 UTC m=+286.465639061"
Jul 15 13:11:18.360560 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:18.360526    2561 patch_prober.go:28] interesting pod/image-registry-7ccdf4bf97-g5wd7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:11:18.361086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:18.360584    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7" podUID="6d1222dc-5056-43b0-80a6-3827ac08d6e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:11:18.820753 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:18.820578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:11:18.823705 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:18.823623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1-metrics-tls\") pod \"dns-default-lmkbx\" (UID: \"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1\") " pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:11:19.038017 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:19.037894    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-txt24\""
Jul 15 13:11:19.045356 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:19.045301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:11:21.137780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:21.137741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lmkbx"]
Jul 15 13:11:21.141888 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:21.141853    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d31f6b8_0ea5_4d10_9aef_b9f3fda4bce1.slice/crio-c21f25fa5ead54fc9cf6ed4777b5e8fcd8d6bd67b894231ae1c6f4613c7974e1 WatchSource:0}: Error finding container c21f25fa5ead54fc9cf6ed4777b5e8fcd8d6bd67b894231ae1c6f4613c7974e1: Status 404 returned error can't find the container with id c21f25fa5ead54fc9cf6ed4777b5e8fcd8d6bd67b894231ae1c6f4613c7974e1
Jul 15 13:11:21.477876 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:21.477841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lmkbx" event={"ID":"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1","Type":"ContainerStarted","Data":"c21f25fa5ead54fc9cf6ed4777b5e8fcd8d6bd67b894231ae1c6f4613c7974e1"}
Jul 15 13:11:21.480363 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:21.480322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-slg62" event={"ID":"45fff1a8-86c1-4ba7-b982-71a86a255235","Type":"ContainerStarted","Data":"e5e84360658d1aac8694c9f1b7b2c77017c49f01e3ea9b87776bede6d5d25de3"}
Jul 15 13:11:22.573749 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:22.573708    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:22.574313 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:22.573865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:22.575390 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:22.575361    2561 patch_prober.go:28] interesting pod/console-6bb5b6c8c8-cb7w7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jul 15 13:11:22.575516 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:22.575416    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6bb5b6c8c8-cb7w7" podUID="335489bf-7f66-47f5-972b-14533a00dd4d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jul 15 13:11:24.495613 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:24.495570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h" event={"ID":"8aa924a8-2b91-49b8-977d-e74a08bab0e7","Type":"ContainerStarted","Data":"f67809dc3dcaff5ff5f46dd6be8b5193f145fb4f6ae222a8556b37a37e4f8f5e"}
Jul 15 13:11:24.496093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:24.495640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h" event={"ID":"8aa924a8-2b91-49b8-977d-e74a08bab0e7","Type":"ContainerStarted","Data":"bab63913027ab01bcc1501940d13cf9a3a510aaa3f4e4f651b4768a56cefbb42"}
Jul 15 13:11:24.519003 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:24.518333    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-slm8h" podStartSLOduration=12.88706082 podStartE2EDuration="20.518311724s" totalImagesPullingTime="7.631250904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:24.516256697 +0000 UTC m=+293.465274170" watchObservedRunningTime="2026-07-15 13:11:24.518311724 +0000 UTC m=+293.467329195"
Jul 15 13:11:26.506487 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:26.506456    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:11:26.506965 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:26.506504    2561 generic.go:356] "Generic (PLEG): container finished" podID="6619589a-6871-41f1-a3bb-278fd395c762" containerID="18ab799eb5bed3ba4193aac62031470a45ccb32b600a1aa722ed30df0770267f" exitCode=2
Jul 15 13:11:26.506965 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:26.506580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76" event={"ID":"6619589a-6871-41f1-a3bb-278fd395c762","Type":"ContainerDied","Data":"18ab799eb5bed3ba4193aac62031470a45ccb32b600a1aa722ed30df0770267f"}
Jul 15 13:11:26.506965 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:26.506939    2561 scope.go:117] "RemoveContainer" containerID="18ab799eb5bed3ba4193aac62031470a45ccb32b600a1aa722ed30df0770267f"
Jul 15 13:11:26.560256 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:26.560223    2561 patch_prober.go:28] interesting pod/image-registry-7ccdf4bf97-g5wd7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:11:26.560449 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:26.560296    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7" podUID="6d1222dc-5056-43b0-80a6-3827ac08d6e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:11:28.358400 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:28.358371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ccdf4bf97-g5wd7"
Jul 15 13:11:28.516873 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:28.516786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lmkbx" event={"ID":"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1","Type":"ContainerStarted","Data":"b7131dadba730350d4fbca02586b6c893a99032ad5fdc1b212534a77e28ef2aa"}
Jul 15 13:11:28.519001 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:28.518978    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:11:28.519124 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:28.519030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wff76" event={"ID":"6619589a-6871-41f1-a3bb-278fd395c762","Type":"ContainerStarted","Data":"aed5000ca36400c737089142f616bafc8c8cf6e294eecaecf89651746ef8a7da"}
Jul 15 13:11:29.526322 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:29.526267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-slg62" event={"ID":"45fff1a8-86c1-4ba7-b982-71a86a255235","Type":"ContainerStarted","Data":"636eb069ef3c8b4a9054b9209381e619cacc286547740c344de8abc285ebb93e"}
Jul 15 13:11:29.528061 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:29.528035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lmkbx" event={"ID":"9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1","Type":"ContainerStarted","Data":"e134e9ee1d1eb88c5c37eaf0e3c2acea59f1cbf8ca8a8037ae1583c02725282b"}
Jul 15 13:11:29.528192 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:29.528083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:11:29.546413 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:29.546370    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-slg62" podStartSLOduration=34.325336797 podStartE2EDuration="58.546355534s" totalImagesPullingTime="24.221018737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:10:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:29.544415738 +0000 UTC m=+298.493433208" watchObservedRunningTime="2026-07-15 13:11:29.546355534 +0000 UTC m=+298.495373004"
Jul 15 13:11:29.562475 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:29.562414    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lmkbx" podStartSLOduration=254.462297224 podStartE2EDuration="4m21.562392639s" totalImagesPullingTime="7.100095415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:29.561826682 +0000 UTC m=+298.510844176" watchObservedRunningTime="2026-07-15 13:11:29.562392639 +0000 UTC m=+298.511410110"
Jul 15 13:11:29.580333 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:11:29.580296    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2fj7r" podUID="f02e7e8e-7628-4291-bcc6-203da9da2216"
Jul 15 13:11:31.417134 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.417100    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:11:31.418842 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.418819    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:11:31.420468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.420438    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:11:31.421590 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.421572    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:11:31.430656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.430629    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:11:31.431853 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.431833    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:11:31.433838 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.433820    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 13:11:31.900418 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.900384    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bwn5q"]
Jul 15 13:11:31.916516 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.916487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:31.919550 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.919523    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 13:11:31.919696 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.919564    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fx726\""
Jul 15 13:11:31.919696 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.919593    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 13:11:31.919810 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:31.919802    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 13:11:32.041391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26bh\" (UniqueName: \"kubernetes.io/projected/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-kube-api-access-v26bh\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-wtmp\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-sys\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-metrics-client-ca\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-tls\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-textfile\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.041663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.041652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-root\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-metrics-client-ca\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-tls\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-textfile\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-root\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26bh\" (UniqueName: \"kubernetes.io/projected/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-kube-api-access-v26bh\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-root\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-wtmp\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-sys\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:11:32.142465    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-wtmp\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:11:32.142529    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-tls podName:039e496d-7b5b-42e2-9a11-9fbb9c5db1be nodeName:}" failed. No retries permitted until 2026-07-15 13:11:32.642508456 +0000 UTC m=+301.591525939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-tls") pod "node-exporter-bwn5q" (UID: "039e496d-7b5b-42e2-9a11-9fbb9c5db1be") : secret "node-exporter-tls" not found
Jul 15 13:11:32.142611 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142549    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-sys\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-textfile\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-metrics-client-ca\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.142988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.142884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.144589 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.144569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.151156 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.151098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26bh\" (UniqueName: \"kubernetes.io/projected/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-kube-api-access-v26bh\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.577646 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.577618    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:32.581667 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.581641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:32.646931 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.646883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-tls\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.653594 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.653077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/039e496d-7b5b-42e2-9a11-9fbb9c5db1be-node-exporter-tls\") pod \"node-exporter-bwn5q\" (UID: \"039e496d-7b5b-42e2-9a11-9fbb9c5db1be\") " pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.826725 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.826688    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwn5q"
Jul 15 13:11:32.872682 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:32.872649    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039e496d_7b5b_42e2_9a11_9fbb9c5db1be.slice/crio-e521d2f730be589fabb82b06e1197723ecbf10c54ab9d17d974d084889884bea WatchSource:0}: Error finding container e521d2f730be589fabb82b06e1197723ecbf10c54ab9d17d974d084889884bea: Status 404 returned error can't find the container with id e521d2f730be589fabb82b06e1197723ecbf10c54ab9d17d974d084889884bea
Jul 15 13:11:32.874914 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:32.874895    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:11:33.542904 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:33.542870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwn5q" event={"ID":"039e496d-7b5b-42e2-9a11-9fbb9c5db1be","Type":"ContainerStarted","Data":"e521d2f730be589fabb82b06e1197723ecbf10c54ab9d17d974d084889884bea"}
Jul 15 13:11:34.241080 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:34.241055    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb5b6c8c8-cb7w7"]
Jul 15 13:11:34.547710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:34.547626    2561 generic.go:356] "Generic (PLEG): container finished" podID="039e496d-7b5b-42e2-9a11-9fbb9c5db1be" containerID="1e20d0a2b983aa359ea36d420ad1a15cc5111cacd42c201a0033c3b4f5602e36" exitCode=0
Jul 15 13:11:34.547868 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:34.547716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwn5q" event={"ID":"039e496d-7b5b-42e2-9a11-9fbb9c5db1be","Type":"ContainerDied","Data":"1e20d0a2b983aa359ea36d420ad1a15cc5111cacd42c201a0033c3b4f5602e36"}
Jul 15 13:11:35.553552 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:35.553516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwn5q" event={"ID":"039e496d-7b5b-42e2-9a11-9fbb9c5db1be","Type":"ContainerStarted","Data":"d2c1224246d37f6a7c7b4059fcc928e1dc2cdfae7569c2448aad1fe516f5fe1b"}
Jul 15 13:11:35.554125 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:35.553565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwn5q" event={"ID":"039e496d-7b5b-42e2-9a11-9fbb9c5db1be","Type":"ContainerStarted","Data":"b42c7a8da5210c35c96dff4dfe866c425a8f9648fa2137645aa5540cf0c37487"}
Jul 15 13:11:35.578468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:35.578416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bwn5q" podStartSLOduration=3.162766542 podStartE2EDuration="4.57839883s" totalImagesPullingTime="1.359223454s" totalInitContainerRuntime="56.408834ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:35.57661232 +0000 UTC m=+304.525629790" watchObservedRunningTime="2026-07-15 13:11:35.57839883 +0000 UTC m=+304.527416301"
Jul 15 13:11:36.732226 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.732190    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69866f4769-s9552"]
Jul 15 13:11:36.759566 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.759511    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"]
Jul 15 13:11:36.759761 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.759666    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.772128 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.769570    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 13:11:36.775520 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.775495    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69866f4769-s9552"]
Jul 15 13:11:36.775648 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.775532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"]
Jul 15 13:11:36.775648 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.775610    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.778103 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.778082    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ghzn2\""
Jul 15 13:11:36.778221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.778121    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 13:11:36.789263 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xlch\" (UniqueName: \"kubernetes.io/projected/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-kube-api-access-6xlch\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.789380 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-oauth-serving-cert\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.789380 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a09a6ff-4048-4927-bf2c-e9e8f35a0424-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d5lcq\" (UID: \"9a09a6ff-4048-4927-bf2c-e9e8f35a0424\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.789380 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-serving-cert\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.789380 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-oauth-config\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.789380 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m766s\" (UniqueName: \"kubernetes.io/projected/9a09a6ff-4048-4927-bf2c-e9e8f35a0424-kube-api-access-m766s\") pod \"monitoring-plugin-5f68df7f58-d5lcq\" (UID: \"9a09a6ff-4048-4927-bf2c-e9e8f35a0424\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.789540 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-service-ca\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.789540 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-trusted-ca-bundle\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.789540 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.789495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-config\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890607 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xlch\" (UniqueName: \"kubernetes.io/projected/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-kube-api-access-6xlch\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890607 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-oauth-serving-cert\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a09a6ff-4048-4927-bf2c-e9e8f35a0424-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d5lcq\" (UID: \"9a09a6ff-4048-4927-bf2c-e9e8f35a0424\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-serving-cert\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-oauth-config\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m766s\" (UniqueName: \"kubernetes.io/projected/9a09a6ff-4048-4927-bf2c-e9e8f35a0424-kube-api-access-m766s\") pod \"monitoring-plugin-5f68df7f58-d5lcq\" (UID: \"9a09a6ff-4048-4927-bf2c-e9e8f35a0424\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-service-ca\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-trusted-ca-bundle\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.890900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.890843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-config\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.891561 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.891527    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-config\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.891673 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.891544    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-service-ca\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.891795 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.891767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-oauth-serving-cert\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.891903 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.891879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-trusted-ca-bundle\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.893364 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.893341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-oauth-config\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.893364 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.893353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-serving-cert\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:36.893519 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.893503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a09a6ff-4048-4927-bf2c-e9e8f35a0424-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d5lcq\" (UID: \"9a09a6ff-4048-4927-bf2c-e9e8f35a0424\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.900511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.900491    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m766s\" (UniqueName: \"kubernetes.io/projected/9a09a6ff-4048-4927-bf2c-e9e8f35a0424-kube-api-access-m766s\") pod \"monitoring-plugin-5f68df7f58-d5lcq\" (UID: \"9a09a6ff-4048-4927-bf2c-e9e8f35a0424\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:36.900511 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:36.900504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xlch\" (UniqueName: \"kubernetes.io/projected/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-kube-api-access-6xlch\") pod \"console-69866f4769-s9552\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") " pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:37.075180 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.075098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:37.084215 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.084187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:37.277417 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.277393    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69866f4769-s9552"]
Jul 15 13:11:37.281702 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:37.281675    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74de47f_1f6f_4cda_9207_5d2a8ba813c8.slice/crio-d3f74e0d1cc4e5ecedeeb87c91ff0adca8f17812861fa1cf4ddfa3da97307773 WatchSource:0}: Error finding container d3f74e0d1cc4e5ecedeeb87c91ff0adca8f17812861fa1cf4ddfa3da97307773: Status 404 returned error can't find the container with id d3f74e0d1cc4e5ecedeeb87c91ff0adca8f17812861fa1cf4ddfa3da97307773
Jul 15 13:11:37.288130 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.288103    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"]
Jul 15 13:11:37.290496 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:37.290474    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a09a6ff_4048_4927_bf2c_e9e8f35a0424.slice/crio-a79a2c9e0b5a3aeae167d683f1f7de0f85b7c891f872fc510dacd1476314230c WatchSource:0}: Error finding container a79a2c9e0b5a3aeae167d683f1f7de0f85b7c891f872fc510dacd1476314230c: Status 404 returned error can't find the container with id a79a2c9e0b5a3aeae167d683f1f7de0f85b7c891f872fc510dacd1476314230c
Jul 15 13:11:37.562898 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.562859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq" event={"ID":"9a09a6ff-4048-4927-bf2c-e9e8f35a0424","Type":"ContainerStarted","Data":"a79a2c9e0b5a3aeae167d683f1f7de0f85b7c891f872fc510dacd1476314230c"}
Jul 15 13:11:37.564317 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.564265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69866f4769-s9552" event={"ID":"d74de47f-1f6f-4cda-9207-5d2a8ba813c8","Type":"ContainerStarted","Data":"da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3"}
Jul 15 13:11:37.564447 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.564333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69866f4769-s9552" event={"ID":"d74de47f-1f6f-4cda-9207-5d2a8ba813c8","Type":"ContainerStarted","Data":"d3f74e0d1cc4e5ecedeeb87c91ff0adca8f17812861fa1cf4ddfa3da97307773"}
Jul 15 13:11:37.585251 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:37.585150    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69866f4769-s9552" podStartSLOduration=1.585131653 podStartE2EDuration="1.585131653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:37.584921999 +0000 UTC m=+306.533939486" watchObservedRunningTime="2026-07-15 13:11:37.585131653 +0000 UTC m=+306.534149125"
Jul 15 13:11:39.534119 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:39.534088    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lmkbx"
Jul 15 13:11:41.581022 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.580995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:11:41.669195 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.669167    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69866f4769-s9552"]
Jul 15 13:11:41.699776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.699747    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85bb76b94d-rxgfp"]
Jul 15 13:11:41.718595 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.718562    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85bb76b94d-rxgfp"]
Jul 15 13:11:41.718758 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.718685    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735292 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-serving-cert\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-oauth-config\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-config\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-service-ca\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xpfr\" (UniqueName: \"kubernetes.io/projected/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-kube-api-access-9xpfr\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-oauth-serving-cert\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.735734 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.735568    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-trusted-ca-bundle\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836068 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.835965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-config\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836068 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-service-ca\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836068 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xpfr\" (UniqueName: \"kubernetes.io/projected/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-kube-api-access-9xpfr\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-oauth-serving-cert\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-trusted-ca-bundle\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-serving-cert\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-oauth-config\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.836894 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-config\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.837024 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.836952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-oauth-serving-cert\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.837158 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.837132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-trusted-ca-bundle\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.837226 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.837138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-service-ca\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.838804 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.838786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-serving-cert\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.838898 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.838792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-oauth-config\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:41.845451 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:41.845426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xpfr\" (UniqueName: \"kubernetes.io/projected/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-kube-api-access-9xpfr\") pod \"console-85bb76b94d-rxgfp\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") " pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:42.028146 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.028110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:42.210237 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.210211    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85bb76b94d-rxgfp"]
Jul 15 13:11:42.212570 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:11:42.212537    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c72d2a_ab80_4ed6_a8bb_9cd69742ef99.slice/crio-8272f9d9303c51b5ad006cfb5cbd96e5a79659287f6e0d28542b4c82d78d2408 WatchSource:0}: Error finding container 8272f9d9303c51b5ad006cfb5cbd96e5a79659287f6e0d28542b4c82d78d2408: Status 404 returned error can't find the container with id 8272f9d9303c51b5ad006cfb5cbd96e5a79659287f6e0d28542b4c82d78d2408
Jul 15 13:11:42.587230 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.587197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb76b94d-rxgfp" event={"ID":"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99","Type":"ContainerStarted","Data":"4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f"}
Jul 15 13:11:42.587689 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.587253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb76b94d-rxgfp" event={"ID":"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99","Type":"ContainerStarted","Data":"8272f9d9303c51b5ad006cfb5cbd96e5a79659287f6e0d28542b4c82d78d2408"}
Jul 15 13:11:42.588764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.588739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq" event={"ID":"9a09a6ff-4048-4927-bf2c-e9e8f35a0424","Type":"ContainerStarted","Data":"cb45c59c44161f930f4b123002c629dc43e3d17cff1e28f6610d25ab55e3a43a"}
Jul 15 13:11:42.588894 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.588879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:42.593638 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.593614    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq"
Jul 15 13:11:42.606875 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.606803    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85bb76b94d-rxgfp" podStartSLOduration=1.606772636 podStartE2EDuration="1.606772636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:42.606771056 +0000 UTC m=+311.555788529" watchObservedRunningTime="2026-07-15 13:11:42.606772636 +0000 UTC m=+311.555790107"
Jul 15 13:11:42.626053 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:42.625994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d5lcq" podStartSLOduration=2.37230849 podStartE2EDuration="6.62597979s" totalImagesPullingTime="4.2536713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:42.624805122 +0000 UTC m=+311.573822593" watchObservedRunningTime="2026-07-15 13:11:42.62597979 +0000 UTC m=+311.574997326"
Jul 15 13:11:47.075382 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:47.075344    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:11:52.028243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:52.028199    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:52.028732 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:52.028322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:52.033291 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:52.033250    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:52.627724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:52.627612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:11:57.644519 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:57.644486    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ad5b723-9fed-4b14-8aa8-8d8f84e7067c" containerID="0f2fcfbb164cfc6f06490e901b2b220c4a3e3837265d034c20131068ceb6d747" exitCode=0
Jul 15 13:11:57.644887 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:57.644560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g" event={"ID":"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c","Type":"ContainerDied","Data":"0f2fcfbb164cfc6f06490e901b2b220c4a3e3837265d034c20131068ceb6d747"}
Jul 15 13:11:57.644931 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:57.644912    2561 scope.go:117] "RemoveContainer" containerID="0f2fcfbb164cfc6f06490e901b2b220c4a3e3837265d034c20131068ceb6d747"
Jul 15 13:11:58.650314 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:58.650268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lsb9g" event={"ID":"2ad5b723-9fed-4b14-8aa8-8d8f84e7067c","Type":"ContainerStarted","Data":"87273f145bf5966e9e6160eecdf01cf5be274122cd31d982c1064f3a38d89d8f"}
Jul 15 13:11:59.567503 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.567456    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bb5b6c8c8-cb7w7" podUID="335489bf-7f66-47f5-972b-14533a00dd4d" containerName="console" containerID="cri-o://9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b" gracePeriod=15
Jul 15 13:11:59.854681 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.854638    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:11:59.996333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-oauth-config\") pod \"335489bf-7f66-47f5-972b-14533a00dd4d\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") "
Jul 15 13:11:59.996333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996339    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-service-ca\") pod \"335489bf-7f66-47f5-972b-14533a00dd4d\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") "
Jul 15 13:11:59.996549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-serving-cert\") pod \"335489bf-7f66-47f5-972b-14533a00dd4d\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") "
Jul 15 13:11:59.996549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-console-config\") pod \"335489bf-7f66-47f5-972b-14533a00dd4d\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") "
Jul 15 13:11:59.996549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-oauth-serving-cert\") pod \"335489bf-7f66-47f5-972b-14533a00dd4d\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") "
Jul 15 13:11:59.996549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5qzf\" (UniqueName: \"kubernetes.io/projected/335489bf-7f66-47f5-972b-14533a00dd4d-kube-api-access-b5qzf\") pod \"335489bf-7f66-47f5-972b-14533a00dd4d\" (UID: \"335489bf-7f66-47f5-972b-14533a00dd4d\") "
Jul 15 13:11:59.996870 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996842    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "335489bf-7f66-47f5-972b-14533a00dd4d" (UID: "335489bf-7f66-47f5-972b-14533a00dd4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:11:59.996987 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996851    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-console-config" (OuterVolumeSpecName: "console-config") pod "335489bf-7f66-47f5-972b-14533a00dd4d" (UID: "335489bf-7f66-47f5-972b-14533a00dd4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:11:59.996987 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.996874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "335489bf-7f66-47f5-972b-14533a00dd4d" (UID: "335489bf-7f66-47f5-972b-14533a00dd4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:11:59.998684 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.998655    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "335489bf-7f66-47f5-972b-14533a00dd4d" (UID: "335489bf-7f66-47f5-972b-14533a00dd4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:11:59.998684 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.998676    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/335489bf-7f66-47f5-972b-14533a00dd4d-kube-api-access-b5qzf" (OuterVolumeSpecName: "kube-api-access-b5qzf") pod "335489bf-7f66-47f5-972b-14533a00dd4d" (UID: "335489bf-7f66-47f5-972b-14533a00dd4d"). InnerVolumeSpecName "kube-api-access-b5qzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:11:59.998823 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:11:59.998734    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "335489bf-7f66-47f5-972b-14533a00dd4d" (UID: "335489bf-7f66-47f5-972b-14533a00dd4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:12:00.097492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.097415    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-oauth-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:00.097492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.097440    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:00.097492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.097449    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335489bf-7f66-47f5-972b-14533a00dd4d-console-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:00.097492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.097460    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-console-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:00.097492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.097468    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335489bf-7f66-47f5-972b-14533a00dd4d-oauth-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:00.097492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.097477    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5qzf\" (UniqueName: \"kubernetes.io/projected/335489bf-7f66-47f5-972b-14533a00dd4d-kube-api-access-b5qzf\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:00.659023 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.658989    2561 generic.go:356] "Generic (PLEG): container finished" podID="335489bf-7f66-47f5-972b-14533a00dd4d" containerID="9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b" exitCode=0
Jul 15 13:12:00.659198 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.659034    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb5b6c8c8-cb7w7"
Jul 15 13:12:00.659198 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.659083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb5b6c8c8-cb7w7" event={"ID":"335489bf-7f66-47f5-972b-14533a00dd4d","Type":"ContainerDied","Data":"9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b"}
Jul 15 13:12:00.659198 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.659121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb5b6c8c8-cb7w7" event={"ID":"335489bf-7f66-47f5-972b-14533a00dd4d","Type":"ContainerDied","Data":"a06a1297444ea01f5c3ce219907b2b28d978c456a3155dde9f3bc2c076cc8dba"}
Jul 15 13:12:00.659198 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.659140    2561 scope.go:117] "RemoveContainer" containerID="9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b"
Jul 15 13:12:00.672348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.671441    2561 scope.go:117] "RemoveContainer" containerID="9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b"
Jul 15 13:12:00.672348 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:12:00.671932    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b\": container with ID starting with 9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b not found: ID does not exist" containerID="9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b"
Jul 15 13:12:00.672348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.671980    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b"} err="failed to get container status \"9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b\": rpc error: code = NotFound desc = could not find container \"9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b\": container with ID starting with 9e700a27c653f7562e408c55b7c799854d1dfdda3fef350bc2803624e92d067b not found: ID does not exist"
Jul 15 13:12:00.681750 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.681723    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb5b6c8c8-cb7w7"]
Jul 15 13:12:00.687269 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:00.687242    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bb5b6c8c8-cb7w7"]
Jul 15 13:12:01.584503 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:01.584433    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="335489bf-7f66-47f5-972b-14533a00dd4d" path="/var/lib/kubelet/pods/335489bf-7f66-47f5-972b-14533a00dd4d/volumes"
Jul 15 13:12:01.664552 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:01.664523    2561 generic.go:356] "Generic (PLEG): container finished" podID="fbce2ac0-78c6-4dc2-bb4e-59535131e713" containerID="dcf73c83d01286314db55eaefd5ca025d51c5e292363048b0d055fa453f52f16" exitCode=0
Jul 15 13:12:01.664715 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:01.664600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt" event={"ID":"fbce2ac0-78c6-4dc2-bb4e-59535131e713","Type":"ContainerDied","Data":"dcf73c83d01286314db55eaefd5ca025d51c5e292363048b0d055fa453f52f16"}
Jul 15 13:12:01.664993 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:01.664977    2561 scope.go:117] "RemoveContainer" containerID="dcf73c83d01286314db55eaefd5ca025d51c5e292363048b0d055fa453f52f16"
Jul 15 13:12:02.670916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:02.670878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bm7rt" event={"ID":"fbce2ac0-78c6-4dc2-bb4e-59535131e713","Type":"ContainerStarted","Data":"681c87f140d1447f049463b1d1b3e4f9e50162c69251f2154770f040f713bb91"}
Jul 15 13:12:06.690617 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:06.690565    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69866f4769-s9552" podUID="d74de47f-1f6f-4cda-9207-5d2a8ba813c8" containerName="console" containerID="cri-o://da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3" gracePeriod=15
Jul 15 13:12:06.974224 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:06.974193    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:12:07.056339 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-oauth-serving-cert\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056514 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xlch\" (UniqueName: \"kubernetes.io/projected/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-kube-api-access-6xlch\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056514 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-oauth-config\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056514 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056424    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-serving-cert\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056514 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056492    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-config\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056540    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-service-ca\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056563    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-trusted-ca-bundle\") pod \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\" (UID: \"d74de47f-1f6f-4cda-9207-5d2a8ba813c8\") "
Jul 15 13:12:07.056723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:12:07.056976 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056953    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-oauth-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.057067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056985    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-config" (OuterVolumeSpecName: "console-config") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:12:07.057067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.056999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:12:07.057164 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.057068    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:12:07.058766 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.058742    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:12:07.058766 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.058755    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:12:07.058856 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.058776    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-kube-api-access-6xlch" (OuterVolumeSpecName: "kube-api-access-6xlch") pod "d74de47f-1f6f-4cda-9207-5d2a8ba813c8" (UID: "d74de47f-1f6f-4cda-9207-5d2a8ba813c8"). InnerVolumeSpecName "kube-api-access-6xlch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:12:07.157692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.157661    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.157692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.157690    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.157692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.157699    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-trusted-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.157916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.157708    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xlch\" (UniqueName: \"kubernetes.io/projected/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-kube-api-access-6xlch\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.157916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.157717    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-oauth-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.157916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.157726    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74de47f-1f6f-4cda-9207-5d2a8ba813c8-console-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:12:07.696025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.695990    2561 generic.go:356] "Generic (PLEG): container finished" podID="d74de47f-1f6f-4cda-9207-5d2a8ba813c8" containerID="da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3" exitCode=0
Jul 15 13:12:07.696476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.696025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69866f4769-s9552" event={"ID":"d74de47f-1f6f-4cda-9207-5d2a8ba813c8","Type":"ContainerDied","Data":"da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3"}
Jul 15 13:12:07.696476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.696041    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69866f4769-s9552"
Jul 15 13:12:07.696476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.696090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69866f4769-s9552" event={"ID":"d74de47f-1f6f-4cda-9207-5d2a8ba813c8","Type":"ContainerDied","Data":"d3f74e0d1cc4e5ecedeeb87c91ff0adca8f17812861fa1cf4ddfa3da97307773"}
Jul 15 13:12:07.696476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.696110    2561 scope.go:117] "RemoveContainer" containerID="da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3"
Jul 15 13:12:07.704322 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.704303    2561 scope.go:117] "RemoveContainer" containerID="da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3"
Jul 15 13:12:07.704576 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:12:07.704561    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3\": container with ID starting with da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3 not found: ID does not exist" containerID="da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3"
Jul 15 13:12:07.704622 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.704583    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3"} err="failed to get container status \"da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3\": rpc error: code = NotFound desc = could not find container \"da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3\": container with ID starting with da50e8c4879cc30429bf6d4b79789064f275eb3f1e1520736f3cda21eb3049a3 not found: ID does not exist"
Jul 15 13:12:07.711918 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.711894    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69866f4769-s9552"]
Jul 15 13:12:07.718025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:07.717999    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69866f4769-s9552"]
Jul 15 13:12:09.583883 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:09.583853    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74de47f-1f6f-4cda-9207-5d2a8ba813c8" path="/var/lib/kubelet/pods/d74de47f-1f6f-4cda-9207-5d2a8ba813c8/volumes"
Jul 15 13:12:45.487481 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:45.487424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:12:45.489768 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:45.489744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02e7e8e-7628-4291-bcc6-203da9da2216-metrics-certs\") pod \"network-metrics-daemon-2fj7r\" (UID: \"f02e7e8e-7628-4291-bcc6-203da9da2216\") " pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:12:45.784854 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:45.784768    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8tgt2\""
Jul 15 13:12:45.792921 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:45.792893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fj7r"
Jul 15 13:12:45.928088 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:45.927909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2fj7r"]
Jul 15 13:12:45.930891 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:12:45.930858    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02e7e8e_7628_4291_bcc6_203da9da2216.slice/crio-bae4d44583fae473417c4dd235ccecda0c951a76ccea8a25b851fdae6198ffb1 WatchSource:0}: Error finding container bae4d44583fae473417c4dd235ccecda0c951a76ccea8a25b851fdae6198ffb1: Status 404 returned error can't find the container with id bae4d44583fae473417c4dd235ccecda0c951a76ccea8a25b851fdae6198ffb1
Jul 15 13:12:46.855609 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:46.855449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2fj7r" event={"ID":"f02e7e8e-7628-4291-bcc6-203da9da2216","Type":"ContainerStarted","Data":"f1f13bb5e89f8c2d9c65659168fecdaba478954642547c18809cb097d87494c4"}
Jul 15 13:12:46.855609 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:46.855568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2fj7r" event={"ID":"f02e7e8e-7628-4291-bcc6-203da9da2216","Type":"ContainerStarted","Data":"bae4d44583fae473417c4dd235ccecda0c951a76ccea8a25b851fdae6198ffb1"}
Jul 15 13:12:47.860749 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:47.860707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2fj7r" event={"ID":"f02e7e8e-7628-4291-bcc6-203da9da2216","Type":"ContainerStarted","Data":"4746cd181cc05987632bfa3ed610309de2d762a1a9c286633460ec5f7e80dddf"}
Jul 15 13:12:47.882936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:47.882885    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2fj7r" podStartSLOduration=376.078468236 podStartE2EDuration="6m16.882870487s" totalImagesPullingTime="804.402251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:47.881701696 +0000 UTC m=+376.830719169" watchObservedRunningTime="2026-07-15 13:12:47.882870487 +0000 UTC m=+376.831887957"
Jul 15 13:12:51.345174 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345144    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669cc46998-t4rlp"]
Jul 15 13:12:51.345636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345438    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="335489bf-7f66-47f5-972b-14533a00dd4d" containerName="console"
Jul 15 13:12:51.345636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345449    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="335489bf-7f66-47f5-972b-14533a00dd4d" containerName="console"
Jul 15 13:12:51.345636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345458    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74de47f-1f6f-4cda-9207-5d2a8ba813c8" containerName="console"
Jul 15 13:12:51.345636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345463    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74de47f-1f6f-4cda-9207-5d2a8ba813c8" containerName="console"
Jul 15 13:12:51.345636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345523    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="335489bf-7f66-47f5-972b-14533a00dd4d" containerName="console"
Jul 15 13:12:51.345636 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.345530    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74de47f-1f6f-4cda-9207-5d2a8ba813c8" containerName="console"
Jul 15 13:12:51.347603 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.347579    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.362237 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.362208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669cc46998-t4rlp"]
Jul 15 13:12:51.439207 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-serving-cert\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.439207 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-oauth-config\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.439499 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjps6\" (UniqueName: \"kubernetes.io/projected/5997acfd-093d-4162-84db-994df90ae5a5-kube-api-access-zjps6\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.439499 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-trusted-ca-bundle\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.439499 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-oauth-serving-cert\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.439499 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-console-config\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.439638 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.439515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-service-ca\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.539903 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.539870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjps6\" (UniqueName: \"kubernetes.io/projected/5997acfd-093d-4162-84db-994df90ae5a5-kube-api-access-zjps6\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.539933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-trusted-ca-bundle\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.539966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-oauth-serving-cert\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.539993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-console-config\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.540032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-service-ca\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540359 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.540248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-serving-cert\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540359 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.540299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-oauth-config\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.540888 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.540862    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-console-config\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.541023 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.540888    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-service-ca\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.541023 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.540919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-trusted-ca-bundle\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.541172 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.541153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-oauth-serving-cert\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.543338 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.543317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-serving-cert\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.543427 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.543397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-oauth-config\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.548329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.548313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjps6\" (UniqueName: \"kubernetes.io/projected/5997acfd-093d-4162-84db-994df90ae5a5-kube-api-access-zjps6\") pod \"console-669cc46998-t4rlp\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") " pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.657425 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.657342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:12:51.788424 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.788342    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669cc46998-t4rlp"]
Jul 15 13:12:51.790571 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:12:51.790541    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5997acfd_093d_4162_84db_994df90ae5a5.slice/crio-456b285a71f2a83a88977b0000e282c11f22f52cc188b1887baff4fdc59a182e WatchSource:0}: Error finding container 456b285a71f2a83a88977b0000e282c11f22f52cc188b1887baff4fdc59a182e: Status 404 returned error can't find the container with id 456b285a71f2a83a88977b0000e282c11f22f52cc188b1887baff4fdc59a182e
Jul 15 13:12:51.877422 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.877388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669cc46998-t4rlp" event={"ID":"5997acfd-093d-4162-84db-994df90ae5a5","Type":"ContainerStarted","Data":"822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2"}
Jul 15 13:12:51.877581 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.877439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669cc46998-t4rlp" event={"ID":"5997acfd-093d-4162-84db-994df90ae5a5","Type":"ContainerStarted","Data":"456b285a71f2a83a88977b0000e282c11f22f52cc188b1887baff4fdc59a182e"}
Jul 15 13:12:51.902174 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:12:51.902117    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669cc46998-t4rlp" podStartSLOduration=0.902084891 podStartE2EDuration="902.084891ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:51.901746755 +0000 UTC m=+380.850764246" watchObservedRunningTime="2026-07-15 13:12:51.902084891 +0000 UTC m=+380.851102362"
Jul 15 13:13:01.657832 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:01.657791    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:13:01.658265 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:01.657858    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:13:01.662711 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:01.662686    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:13:01.924210 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:01.924128    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:13:01.975723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:01.975687    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85bb76b94d-rxgfp"]
Jul 15 13:13:27.000539 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.000479    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85bb76b94d-rxgfp" podUID="a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" containerName="console" containerID="cri-o://4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f" gracePeriod=15
Jul 15 13:13:27.244653 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.244629    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:13:27.330959 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.330870    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-serving-cert\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.330959 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.330928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-trusted-ca-bundle\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.331175 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.330962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-service-ca\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.331175 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.330990    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xpfr\" (UniqueName: \"kubernetes.io/projected/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-kube-api-access-9xpfr\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.331175 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331029    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-oauth-serving-cert\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.331175 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331063    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-oauth-config\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.331175 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331120    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-config\") pod \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\" (UID: \"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99\") "
Jul 15 13:13:27.331581 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331473    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:13:27.331696 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331444    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:13:27.331696 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331598    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:13:27.331696 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.331688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-config" (OuterVolumeSpecName: "console-config") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:13:27.333090 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.333069    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:13:27.333164 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.333100    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:13:27.333164 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.333105    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-kube-api-access-9xpfr" (OuterVolumeSpecName: "kube-api-access-9xpfr") pod "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" (UID: "a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99"). InnerVolumeSpecName "kube-api-access-9xpfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:13:27.431841 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431802    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-trusted-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:27.431841 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431835    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:27.431841 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431845    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xpfr\" (UniqueName: \"kubernetes.io/projected/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-kube-api-access-9xpfr\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:27.431841 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431854    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-oauth-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:27.432099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431863    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-oauth-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:27.432099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431871    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:27.432099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:27.431879    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99-console-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:13:28.017017 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.016982    2561 generic.go:356] "Generic (PLEG): container finished" podID="a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" containerID="4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f" exitCode=0
Jul 15 13:13:28.017463 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.017030    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb76b94d-rxgfp"
Jul 15 13:13:28.017463 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.017033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb76b94d-rxgfp" event={"ID":"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99","Type":"ContainerDied","Data":"4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f"}
Jul 15 13:13:28.017463 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.017139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb76b94d-rxgfp" event={"ID":"a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99","Type":"ContainerDied","Data":"8272f9d9303c51b5ad006cfb5cbd96e5a79659287f6e0d28542b4c82d78d2408"}
Jul 15 13:13:28.017463 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.017163    2561 scope.go:117] "RemoveContainer" containerID="4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f"
Jul 15 13:13:28.027731 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.027708    2561 scope.go:117] "RemoveContainer" containerID="4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f"
Jul 15 13:13:28.028011 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:13:28.027992    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f\": container with ID starting with 4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f not found: ID does not exist" containerID="4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f"
Jul 15 13:13:28.028062 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.028022    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f"} err="failed to get container status \"4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f\": rpc error: code = NotFound desc = could not find container \"4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f\": container with ID starting with 4d6f8b62330d444eac88d61eb8a7eb60bcc051225862088db0a0744f6396ca9f not found: ID does not exist"
Jul 15 13:13:28.034405 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.034381    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85bb76b94d-rxgfp"]
Jul 15 13:13:28.038212 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:28.038190    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85bb76b94d-rxgfp"]
Jul 15 13:13:29.583882 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:29.583850    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" path="/var/lib/kubelet/pods/a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99/volumes"
Jul 15 13:13:40.597909 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.597868    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"]
Jul 15 13:13:40.598478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.598295    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" containerName="console"
Jul 15 13:13:40.598478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.598313    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" containerName="console"
Jul 15 13:13:40.598478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.598418    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3c72d2a-ab80-4ed6-a8bb-9cd69742ef99" containerName="console"
Jul 15 13:13:40.601523 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.601501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.604057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.604035    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 13:13:40.605021 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.604991    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xtk\""
Jul 15 13:13:40.605021 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.605012    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 13:13:40.610727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.610703    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"]
Jul 15 13:13:40.627644 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.627614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.627831 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.627719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.627891 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.627851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7nd\" (UniqueName: \"kubernetes.io/projected/f0f4f608-0630-480d-b75a-046c1987cd60-kube-api-access-7j7nd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.728412 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.728370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.728567 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.728524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7nd\" (UniqueName: \"kubernetes.io/projected/f0f4f608-0630-480d-b75a-046c1987cd60-kube-api-access-7j7nd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.728606 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.728568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.728795 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.728771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.728892 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.728872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.738398 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.738368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7nd\" (UniqueName: \"kubernetes.io/projected/f0f4f608-0630-480d-b75a-046c1987cd60-kube-api-access-7j7nd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:40.910974 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:40.910858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:13:41.053712 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:41.053687    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"]
Jul 15 13:13:41.055965 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:13:41.055938    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f4f608_0630_480d_b75a_046c1987cd60.slice/crio-8782c3ea8cf46943b99e1f05858b3badecb38d327a48adc971909bd66ad62fbd WatchSource:0}: Error finding container 8782c3ea8cf46943b99e1f05858b3badecb38d327a48adc971909bd66ad62fbd: Status 404 returned error can't find the container with id 8782c3ea8cf46943b99e1f05858b3badecb38d327a48adc971909bd66ad62fbd
Jul 15 13:13:41.069472 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:41.069447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg" event={"ID":"f0f4f608-0630-480d-b75a-046c1987cd60","Type":"ContainerStarted","Data":"8782c3ea8cf46943b99e1f05858b3badecb38d327a48adc971909bd66ad62fbd"}
Jul 15 13:13:49.104491 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:49.104449    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0f4f608-0630-480d-b75a-046c1987cd60" containerID="09fc9af75fb2e5762ca56b0fb23e6959f748bc4a34cfd280bb254f593217ef58" exitCode=0
Jul 15 13:13:49.104877 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:49.104505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg" event={"ID":"f0f4f608-0630-480d-b75a-046c1987cd60","Type":"ContainerDied","Data":"09fc9af75fb2e5762ca56b0fb23e6959f748bc4a34cfd280bb254f593217ef58"}
Jul 15 13:13:53.122652 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:53.122614    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0f4f608-0630-480d-b75a-046c1987cd60" containerID="5920868b916803985a33c54c3252c19a1d5e9b733844dd8ede91a673f57b88d8" exitCode=0
Jul 15 13:13:53.122999 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:13:53.122687    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg" event={"ID":"f0f4f608-0630-480d-b75a-046c1987cd60","Type":"ContainerDied","Data":"5920868b916803985a33c54c3252c19a1d5e9b733844dd8ede91a673f57b88d8"}
Jul 15 13:14:03.169650 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:03.169609    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0f4f608-0630-480d-b75a-046c1987cd60" containerID="13f9bf6caa82a9bfc1c8fd3a1c3e9565d3335915cd3a0ddd586d864022d90337" exitCode=0
Jul 15 13:14:03.170048 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:03.169682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg" event={"ID":"f0f4f608-0630-480d-b75a-046c1987cd60","Type":"ContainerDied","Data":"13f9bf6caa82a9bfc1c8fd3a1c3e9565d3335915cd3a0ddd586d864022d90337"}
Jul 15 13:14:04.351194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.351158    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:14:04.424776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.424689    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-bundle\") pod \"f0f4f608-0630-480d-b75a-046c1987cd60\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") "
Jul 15 13:14:04.424776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.424740    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j7nd\" (UniqueName: \"kubernetes.io/projected/f0f4f608-0630-480d-b75a-046c1987cd60-kube-api-access-7j7nd\") pod \"f0f4f608-0630-480d-b75a-046c1987cd60\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") "
Jul 15 13:14:04.424977 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.424796    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-util\") pod \"f0f4f608-0630-480d-b75a-046c1987cd60\" (UID: \"f0f4f608-0630-480d-b75a-046c1987cd60\") "
Jul 15 13:14:04.425420 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.425390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-bundle" (OuterVolumeSpecName: "bundle") pod "f0f4f608-0630-480d-b75a-046c1987cd60" (UID: "f0f4f608-0630-480d-b75a-046c1987cd60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:14:04.427021 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.426997    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f4f608-0630-480d-b75a-046c1987cd60-kube-api-access-7j7nd" (OuterVolumeSpecName: "kube-api-access-7j7nd") pod "f0f4f608-0630-480d-b75a-046c1987cd60" (UID: "f0f4f608-0630-480d-b75a-046c1987cd60"). InnerVolumeSpecName "kube-api-access-7j7nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:14:04.429040 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.429016    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-util" (OuterVolumeSpecName: "util") pod "f0f4f608-0630-480d-b75a-046c1987cd60" (UID: "f0f4f608-0630-480d-b75a-046c1987cd60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:14:04.525880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.525848    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:04.525880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.525875    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j7nd\" (UniqueName: \"kubernetes.io/projected/f0f4f608-0630-480d-b75a-046c1987cd60-kube-api-access-7j7nd\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:04.525880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:04.525885    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0f4f608-0630-480d-b75a-046c1987cd60-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:05.179468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:05.179428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg" event={"ID":"f0f4f608-0630-480d-b75a-046c1987cd60","Type":"ContainerDied","Data":"8782c3ea8cf46943b99e1f05858b3badecb38d327a48adc971909bd66ad62fbd"}
Jul 15 13:14:05.179468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:05.179462    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xz9sg"
Jul 15 13:14:05.179687 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:05.179486    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8782c3ea8cf46943b99e1f05858b3badecb38d327a48adc971909bd66ad62fbd"
Jul 15 13:14:08.638246 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638209    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"]
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638525    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="util"
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638536    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="util"
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638552    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="extract"
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638558    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="extract"
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638571    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="pull"
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638576    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="pull"
Jul 15 13:14:08.638657 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.638625    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0f4f608-0630-480d-b75a-046c1987cd60" containerName="extract"
Jul 15 13:14:08.640468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.640451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.643478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.643455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xxlkn\""
Jul 15 13:14:08.643691 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.643678    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 13:14:08.644074 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.644056    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:14:08.666196 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.666175    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"]
Jul 15 13:14:08.764015 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.763970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbztg\" (UniqueName: \"kubernetes.io/projected/e8e7f0aa-01ad-46a4-bd63-6af621c86fe8-kube-api-access-mbztg\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj5wn\" (UID: \"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.764205 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.764068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e7f0aa-01ad-46a4-bd63-6af621c86fe8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj5wn\" (UID: \"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.865243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.865195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbztg\" (UniqueName: \"kubernetes.io/projected/e8e7f0aa-01ad-46a4-bd63-6af621c86fe8-kube-api-access-mbztg\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj5wn\" (UID: \"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.865435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.865318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e7f0aa-01ad-46a4-bd63-6af621c86fe8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj5wn\" (UID: \"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.865668 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.865651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e7f0aa-01ad-46a4-bd63-6af621c86fe8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj5wn\" (UID: \"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.890081 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.890014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbztg\" (UniqueName: \"kubernetes.io/projected/e8e7f0aa-01ad-46a4-bd63-6af621c86fe8-kube-api-access-mbztg\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj5wn\" (UID: \"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:08.949947 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:08.949914    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"
Jul 15 13:14:09.087540 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:09.087504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn"]
Jul 15 13:14:09.091207 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:14:09.091178    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e7f0aa_01ad_46a4_bd63_6af621c86fe8.slice/crio-7f7c1ef23565c99a6e44f2c559c6398e42045ab2b67afea616100acb9eb9abcb WatchSource:0}: Error finding container 7f7c1ef23565c99a6e44f2c559c6398e42045ab2b67afea616100acb9eb9abcb: Status 404 returned error can't find the container with id 7f7c1ef23565c99a6e44f2c559c6398e42045ab2b67afea616100acb9eb9abcb
Jul 15 13:14:09.195995 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:09.195963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn" event={"ID":"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8","Type":"ContainerStarted","Data":"7f7c1ef23565c99a6e44f2c559c6398e42045ab2b67afea616100acb9eb9abcb"}
Jul 15 13:14:11.208189 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:11.208150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn" event={"ID":"e8e7f0aa-01ad-46a4-bd63-6af621c86fe8","Type":"ContainerStarted","Data":"104c951de8f8228b403d2382711e36a0a063f3ea3682dad07d05c9c58ec976b2"}
Jul 15 13:14:11.247157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:11.247105    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj5wn" podStartSLOduration=1.58940908 podStartE2EDuration="3.247087899s" totalImagesPullingTime="1.657678819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:11.247032384 +0000 UTC m=+460.196049855" watchObservedRunningTime="2026-07-15 13:14:11.247087899 +0000 UTC m=+460.196105370"
Jul 15 13:14:12.318324 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.318291    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"]
Jul 15 13:14:12.320600 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.320581    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.323316 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.323295    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 13:14:12.324415 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.324397    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 13:14:12.324517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.324438    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xtk\""
Jul 15 13:14:12.331319 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.331296    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"]
Jul 15 13:14:12.395787 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.395756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.395930 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.395842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4z9\" (UniqueName: \"kubernetes.io/projected/44d8a350-6743-4eca-a60d-e8ada58556bc-kube-api-access-dj4z9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.395930 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.395876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.497258 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.497206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4z9\" (UniqueName: \"kubernetes.io/projected/44d8a350-6743-4eca-a60d-e8ada58556bc-kube-api-access-dj4z9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.497442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.497263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.497442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.497321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.497632 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.497609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.497675 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.497661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.506930 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.506901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4z9\" (UniqueName: \"kubernetes.io/projected/44d8a350-6743-4eca-a60d-e8ada58556bc-kube-api-access-dj4z9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.629604 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.629522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:12.771998 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:12.771973    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"]
Jul 15 13:14:12.774254 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:14:12.774226    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d8a350_6743_4eca_a60d_e8ada58556bc.slice/crio-a01543c98e0965979d901254fc2426f35ddcb027703d5f18ee849c97acbf2e50 WatchSource:0}: Error finding container a01543c98e0965979d901254fc2426f35ddcb027703d5f18ee849c97acbf2e50: Status 404 returned error can't find the container with id a01543c98e0965979d901254fc2426f35ddcb027703d5f18ee849c97acbf2e50
Jul 15 13:14:13.218512 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:13.218479    2561 generic.go:356] "Generic (PLEG): container finished" podID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerID="710359b6c23f2442d91b8855f59719633e03857456747306524ee9f6377d363a" exitCode=0
Jul 15 13:14:13.218512 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:13.218514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5" event={"ID":"44d8a350-6743-4eca-a60d-e8ada58556bc","Type":"ContainerDied","Data":"710359b6c23f2442d91b8855f59719633e03857456747306524ee9f6377d363a"}
Jul 15 13:14:13.218758 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:13.218550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5" event={"ID":"44d8a350-6743-4eca-a60d-e8ada58556bc","Type":"ContainerStarted","Data":"a01543c98e0965979d901254fc2426f35ddcb027703d5f18ee849c97acbf2e50"}
Jul 15 13:14:14.970825 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:14.970799    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ktwlm"]
Jul 15 13:14:14.972779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:14.972761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:14.975553 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:14.975533    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 13:14:14.976644 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:14.976619    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-brnvq\""
Jul 15 13:14:14.976751 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:14.976624    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 13:14:14.984436 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:14.984416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ktwlm"]
Jul 15 13:14:15.120337 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.120304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmtfp\" (UniqueName: \"kubernetes.io/projected/ff3e913a-477c-4005-aeef-b504b3a78572-kube-api-access-cmtfp\") pod \"cert-manager-webhook-6486ffd997-ktwlm\" (UID: \"ff3e913a-477c-4005-aeef-b504b3a78572\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.120463 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.120390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3e913a-477c-4005-aeef-b504b3a78572-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ktwlm\" (UID: \"ff3e913a-477c-4005-aeef-b504b3a78572\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.189531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.189498    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"]
Jul 15 13:14:15.191516 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.191499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.194126 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.194093    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7h88g\""
Jul 15 13:14:15.204956 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.204931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"]
Jul 15 13:14:15.221615 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.221540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3e913a-477c-4005-aeef-b504b3a78572-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ktwlm\" (UID: \"ff3e913a-477c-4005-aeef-b504b3a78572\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.221740 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.221626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmtfp\" (UniqueName: \"kubernetes.io/projected/ff3e913a-477c-4005-aeef-b504b3a78572-kube-api-access-cmtfp\") pod \"cert-manager-webhook-6486ffd997-ktwlm\" (UID: \"ff3e913a-477c-4005-aeef-b504b3a78572\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.229265 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.229239    2561 generic.go:356] "Generic (PLEG): container finished" podID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerID="03b4d9d9fcbc886e4d45546641e6029477f782cfdc18707cdc9f06e7b42bcf75" exitCode=0
Jul 15 13:14:15.229431 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.229341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5" event={"ID":"44d8a350-6743-4eca-a60d-e8ada58556bc","Type":"ContainerDied","Data":"03b4d9d9fcbc886e4d45546641e6029477f782cfdc18707cdc9f06e7b42bcf75"}
Jul 15 13:14:15.231388 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.231357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3e913a-477c-4005-aeef-b504b3a78572-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ktwlm\" (UID: \"ff3e913a-477c-4005-aeef-b504b3a78572\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.231627 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.231606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmtfp\" (UniqueName: \"kubernetes.io/projected/ff3e913a-477c-4005-aeef-b504b3a78572-kube-api-access-cmtfp\") pod \"cert-manager-webhook-6486ffd997-ktwlm\" (UID: \"ff3e913a-477c-4005-aeef-b504b3a78572\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.291517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.291489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:15.322450 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.322417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gs9n\" (UniqueName: \"kubernetes.io/projected/5a15c8f6-0000-4bca-9e75-cbe4522b10ff-kube-api-access-2gs9n\") pod \"cert-manager-cainjector-559cdd8c87-sdkp9\" (UID: \"5a15c8f6-0000-4bca-9e75-cbe4522b10ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.322622 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.322526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a15c8f6-0000-4bca-9e75-cbe4522b10ff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sdkp9\" (UID: \"5a15c8f6-0000-4bca-9e75-cbe4522b10ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.423148 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.423031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a15c8f6-0000-4bca-9e75-cbe4522b10ff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sdkp9\" (UID: \"5a15c8f6-0000-4bca-9e75-cbe4522b10ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.423148 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.423101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gs9n\" (UniqueName: \"kubernetes.io/projected/5a15c8f6-0000-4bca-9e75-cbe4522b10ff-kube-api-access-2gs9n\") pod \"cert-manager-cainjector-559cdd8c87-sdkp9\" (UID: \"5a15c8f6-0000-4bca-9e75-cbe4522b10ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.424593 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.424571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ktwlm"]
Jul 15 13:14:15.427676 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:14:15.427655    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3e913a_477c_4005_aeef_b504b3a78572.slice/crio-41f37ffc4ffc35a6ad7e45eff99757188c59bea6e8d53a555fa8daad918ede32 WatchSource:0}: Error finding container 41f37ffc4ffc35a6ad7e45eff99757188c59bea6e8d53a555fa8daad918ede32: Status 404 returned error can't find the container with id 41f37ffc4ffc35a6ad7e45eff99757188c59bea6e8d53a555fa8daad918ede32
Jul 15 13:14:15.431647 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.431623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a15c8f6-0000-4bca-9e75-cbe4522b10ff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sdkp9\" (UID: \"5a15c8f6-0000-4bca-9e75-cbe4522b10ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.431780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.431759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gs9n\" (UniqueName: \"kubernetes.io/projected/5a15c8f6-0000-4bca-9e75-cbe4522b10ff-kube-api-access-2gs9n\") pod \"cert-manager-cainjector-559cdd8c87-sdkp9\" (UID: \"5a15c8f6-0000-4bca-9e75-cbe4522b10ff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.500625 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.500538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"
Jul 15 13:14:15.645051 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:15.645028    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9"]
Jul 15 13:14:15.647348 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:14:15.647320    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a15c8f6_0000_4bca_9e75_cbe4522b10ff.slice/crio-87b0b8128601458215f1f9c39ec98ee88faff610d6801296e3cce3c6d509b400 WatchSource:0}: Error finding container 87b0b8128601458215f1f9c39ec98ee88faff610d6801296e3cce3c6d509b400: Status 404 returned error can't find the container with id 87b0b8128601458215f1f9c39ec98ee88faff610d6801296e3cce3c6d509b400
Jul 15 13:14:16.236577 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:16.236540    2561 generic.go:356] "Generic (PLEG): container finished" podID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerID="fbc41eabcd6b4db838e7adf01f81cfa5cf2601bd6a2a488e7c3b99676c08393c" exitCode=0
Jul 15 13:14:16.237051 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:16.236636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5" event={"ID":"44d8a350-6743-4eca-a60d-e8ada58556bc","Type":"ContainerDied","Data":"fbc41eabcd6b4db838e7adf01f81cfa5cf2601bd6a2a488e7c3b99676c08393c"}
Jul 15 13:14:16.238077 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:16.238038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9" event={"ID":"5a15c8f6-0000-4bca-9e75-cbe4522b10ff","Type":"ContainerStarted","Data":"87b0b8128601458215f1f9c39ec98ee88faff610d6801296e3cce3c6d509b400"}
Jul 15 13:14:16.239322 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:16.239299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm" event={"ID":"ff3e913a-477c-4005-aeef-b504b3a78572","Type":"ContainerStarted","Data":"41f37ffc4ffc35a6ad7e45eff99757188c59bea6e8d53a555fa8daad918ede32"}
Jul 15 13:14:18.130399 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.130372    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:18.247514 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.247484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-util\") pod \"44d8a350-6743-4eca-a60d-e8ada58556bc\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") "
Jul 15 13:14:18.247707 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.247542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj4z9\" (UniqueName: \"kubernetes.io/projected/44d8a350-6743-4eca-a60d-e8ada58556bc-kube-api-access-dj4z9\") pod \"44d8a350-6743-4eca-a60d-e8ada58556bc\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") "
Jul 15 13:14:18.247707 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.247578    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-bundle\") pod \"44d8a350-6743-4eca-a60d-e8ada58556bc\" (UID: \"44d8a350-6743-4eca-a60d-e8ada58556bc\") "
Jul 15 13:14:18.248166 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.248068    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-bundle" (OuterVolumeSpecName: "bundle") pod "44d8a350-6743-4eca-a60d-e8ada58556bc" (UID: "44d8a350-6743-4eca-a60d-e8ada58556bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:14:18.250512 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.250471    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44d8a350-6743-4eca-a60d-e8ada58556bc-kube-api-access-dj4z9" (OuterVolumeSpecName: "kube-api-access-dj4z9") pod "44d8a350-6743-4eca-a60d-e8ada58556bc" (UID: "44d8a350-6743-4eca-a60d-e8ada58556bc"). InnerVolumeSpecName "kube-api-access-dj4z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:14:18.251979 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.251950    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5" event={"ID":"44d8a350-6743-4eca-a60d-e8ada58556bc","Type":"ContainerDied","Data":"a01543c98e0965979d901254fc2426f35ddcb027703d5f18ee849c97acbf2e50"}
Jul 15 13:14:18.252079 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.251996    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a01543c98e0965979d901254fc2426f35ddcb027703d5f18ee849c97acbf2e50"
Jul 15 13:14:18.252079 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.252063    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmj2k5"
Jul 15 13:14:18.253786 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.253762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9" event={"ID":"5a15c8f6-0000-4bca-9e75-cbe4522b10ff","Type":"ContainerStarted","Data":"3d51ea928f9b8e14722f81d8165ff30c1a04bc250a45f2949f70e83a9f74e867"}
Jul 15 13:14:18.254545 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.254518    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-util" (OuterVolumeSpecName: "util") pod "44d8a350-6743-4eca-a60d-e8ada58556bc" (UID: "44d8a350-6743-4eca-a60d-e8ada58556bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:14:18.256211 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.256044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm" event={"ID":"ff3e913a-477c-4005-aeef-b504b3a78572","Type":"ContainerStarted","Data":"4918dbb480687eaed76c6b85bc0f7bb49ebf258167b80e7970cddc5a8faa0a55"}
Jul 15 13:14:18.256368 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.256352    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:18.277186 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.277123    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sdkp9" podStartSLOduration=0.770155536 podStartE2EDuration="3.277101677s" totalImagesPullingTime="2.506946141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:18.275551403 +0000 UTC m=+467.224568885" watchObservedRunningTime="2026-07-15 13:14:18.277101677 +0000 UTC m=+467.226119152"
Jul 15 13:14:18.348492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.348456    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:18.348492 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.348488    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj4z9\" (UniqueName: \"kubernetes.io/projected/44d8a350-6743-4eca-a60d-e8ada58556bc-kube-api-access-dj4z9\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:18.348875 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:18.348505    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44d8a350-6743-4eca-a60d-e8ada58556bc-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:19.174922 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:19.174864    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm" podStartSLOduration=2.453682306 podStartE2EDuration="5.174844601s" totalImagesPullingTime="2.721162295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:18.294734365 +0000 UTC m=+467.243751861" watchObservedRunningTime="2026-07-15 13:14:19.174844601 +0000 UTC m=+468.123862075"
Jul 15 13:14:24.262011 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:24.261975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ktwlm"
Jul 15 13:14:35.748976 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.748941    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"]
Jul 15 13:14:35.749562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749377    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="pull"
Jul 15 13:14:35.749562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749397    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="pull"
Jul 15 13:14:35.749562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749446    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="extract"
Jul 15 13:14:35.749562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749456    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="extract"
Jul 15 13:14:35.749562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749477    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="util"
Jul 15 13:14:35.749562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749485    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="util"
Jul 15 13:14:35.749864 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.749567    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44d8a350-6743-4eca-a60d-e8ada58556bc" containerName="extract"
Jul 15 13:14:35.772197 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.772160    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"]
Jul 15 13:14:35.772359 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.772301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.775547 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.775524    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 13:14:35.776877 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.776862    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-49xtk\""
Jul 15 13:14:35.777049 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.777036    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 13:14:35.792258 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.792231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnpqp\" (UniqueName: \"kubernetes.io/projected/1b570b9b-dfa2-4b25-b017-3414a6c7355f-kube-api-access-vnpqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.792376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.792264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.792376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.792337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.893518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.893480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpqp\" (UniqueName: \"kubernetes.io/projected/1b570b9b-dfa2-4b25-b017-3414a6c7355f-kube-api-access-vnpqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.893518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.893525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.893739 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.893542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.893881 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.893861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.893921 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.893880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:35.902323 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:35.902295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnpqp\" (UniqueName: \"kubernetes.io/projected/1b570b9b-dfa2-4b25-b017-3414a6c7355f-kube-api-access-vnpqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:36.081929 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:36.081847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:36.216845 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:36.216812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"]
Jul 15 13:14:36.217596 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:14:36.217569    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b570b9b_dfa2_4b25_b017_3414a6c7355f.slice/crio-fdf68b8fb2410485ff48e781199113d8e31bdf656f462a152c20827797074fe0 WatchSource:0}: Error finding container fdf68b8fb2410485ff48e781199113d8e31bdf656f462a152c20827797074fe0: Status 404 returned error can't find the container with id fdf68b8fb2410485ff48e781199113d8e31bdf656f462a152c20827797074fe0
Jul 15 13:14:36.336508 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:36.336426    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerID="565ef6bdc2fc8b269dfc181c67870b3af8d06f3695f6a60142cb150a5da91aa9" exitCode=0
Jul 15 13:14:36.336508 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:36.336464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r" event={"ID":"1b570b9b-dfa2-4b25-b017-3414a6c7355f","Type":"ContainerDied","Data":"565ef6bdc2fc8b269dfc181c67870b3af8d06f3695f6a60142cb150a5da91aa9"}
Jul 15 13:14:36.336713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:36.336528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r" event={"ID":"1b570b9b-dfa2-4b25-b017-3414a6c7355f","Type":"ContainerStarted","Data":"fdf68b8fb2410485ff48e781199113d8e31bdf656f462a152c20827797074fe0"}
Jul 15 13:14:37.342523 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:37.342492    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerID="4144fadc1c5a08125f1455d6a61b8a8e701b215c2e8fe8cfa4a2144d40a9b0e2" exitCode=0
Jul 15 13:14:37.342889 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:37.342565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r" event={"ID":"1b570b9b-dfa2-4b25-b017-3414a6c7355f","Type":"ContainerDied","Data":"4144fadc1c5a08125f1455d6a61b8a8e701b215c2e8fe8cfa4a2144d40a9b0e2"}
Jul 15 13:14:38.348913 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:38.348876    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerID="f5b0e7ad9714efbb19683866c44098a4a55c8c5462a0083fad7627bd674f88f2" exitCode=0
Jul 15 13:14:38.349298 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:38.348967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r" event={"ID":"1b570b9b-dfa2-4b25-b017-3414a6c7355f","Type":"ContainerDied","Data":"f5b0e7ad9714efbb19683866c44098a4a55c8c5462a0083fad7627bd674f88f2"}
Jul 15 13:14:39.486324 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.486299    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:39.520403 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.520370    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-util\") pod \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") "
Jul 15 13:14:39.520571 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.520432    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnpqp\" (UniqueName: \"kubernetes.io/projected/1b570b9b-dfa2-4b25-b017-3414a6c7355f-kube-api-access-vnpqp\") pod \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") "
Jul 15 13:14:39.520571 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.520465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-bundle\") pod \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\" (UID: \"1b570b9b-dfa2-4b25-b017-3414a6c7355f\") "
Jul 15 13:14:39.521410 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.521382    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-bundle" (OuterVolumeSpecName: "bundle") pod "1b570b9b-dfa2-4b25-b017-3414a6c7355f" (UID: "1b570b9b-dfa2-4b25-b017-3414a6c7355f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:14:39.522603 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.522582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b570b9b-dfa2-4b25-b017-3414a6c7355f-kube-api-access-vnpqp" (OuterVolumeSpecName: "kube-api-access-vnpqp") pod "1b570b9b-dfa2-4b25-b017-3414a6c7355f" (UID: "1b570b9b-dfa2-4b25-b017-3414a6c7355f"). InnerVolumeSpecName "kube-api-access-vnpqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:14:39.526873 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.526808    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-util" (OuterVolumeSpecName: "util") pod "1b570b9b-dfa2-4b25-b017-3414a6c7355f" (UID: "1b570b9b-dfa2-4b25-b017-3414a6c7355f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:14:39.621507 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.621421    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnpqp\" (UniqueName: \"kubernetes.io/projected/1b570b9b-dfa2-4b25-b017-3414a6c7355f-kube-api-access-vnpqp\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:39.621507 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.621450    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:39.621507 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:39.621459    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b570b9b-dfa2-4b25-b017-3414a6c7355f-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:14:40.359266 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:40.359232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r" event={"ID":"1b570b9b-dfa2-4b25-b017-3414a6c7355f","Type":"ContainerDied","Data":"fdf68b8fb2410485ff48e781199113d8e31bdf656f462a152c20827797074fe0"}
Jul 15 13:14:40.359266 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:40.359252    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdsr4r"
Jul 15 13:14:40.359483 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:40.359302    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdf68b8fb2410485ff48e781199113d8e31bdf656f462a152c20827797074fe0"
Jul 15 13:14:47.475063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475032    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"]
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475334    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="util"
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475349    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="util"
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475360    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="pull"
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475366    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="pull"
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475377    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="extract"
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475383    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="extract"
Jul 15 13:14:47.475466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.475440    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b570b9b-dfa2-4b25-b017-3414a6c7355f" containerName="extract"
Jul 15 13:14:47.479773 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.479756    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.484778 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.484750    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 13:14:47.484991 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.484976    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 13:14:47.485052 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.485029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-snv8d\""
Jul 15 13:14:47.486401 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.486104    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 13:14:47.486401 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.486388    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 13:14:47.507995 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.507968    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"]
Jul 15 13:14:47.581332 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.581300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e8c64e12-47a2-405d-b887-c0140cd5d4cf-manifests\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.581513 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.581359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8c64e12-47a2-405d-b887-c0140cd5d4cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.581513 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.581405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c64e12-47a2-405d-b887-c0140cd5d4cf-tmp\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.581513 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.581445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e8c64e12-47a2-405d-b887-c0140cd5d4cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.581651 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.581557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgssh\" (UniqueName: \"kubernetes.io/projected/e8c64e12-47a2-405d-b887-c0140cd5d4cf-kube-api-access-mgssh\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.682830 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.682790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e8c64e12-47a2-405d-b887-c0140cd5d4cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.682830 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.682839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgssh\" (UniqueName: \"kubernetes.io/projected/e8c64e12-47a2-405d-b887-c0140cd5d4cf-kube-api-access-mgssh\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.683089 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.683013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e8c64e12-47a2-405d-b887-c0140cd5d4cf-manifests\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.683089 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.683073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8c64e12-47a2-405d-b887-c0140cd5d4cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.683188 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.683101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c64e12-47a2-405d-b887-c0140cd5d4cf-tmp\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.683499 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.683478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e8c64e12-47a2-405d-b887-c0140cd5d4cf-manifests\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.685221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.685195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c64e12-47a2-405d-b887-c0140cd5d4cf-tmp\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.685388 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.685367    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e8c64e12-47a2-405d-b887-c0140cd5d4cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.685435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.685386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8c64e12-47a2-405d-b887-c0140cd5d4cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.691678 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.691650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgssh\" (UniqueName: \"kubernetes.io/projected/e8c64e12-47a2-405d-b887-c0140cd5d4cf-kube-api-access-mgssh\") pod \"opendatahub-operator-controller-manager-869c48857d-gbbhs\" (UID: \"e8c64e12-47a2-405d-b887-c0140cd5d4cf\") " pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.790450 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.790357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:47.928369 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:47.928319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"]
Jul 15 13:14:47.930627 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:14:47.930599    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c64e12_47a2_405d_b887_c0140cd5d4cf.slice/crio-720545f529a6362ef5d7d234da098ebaa82b208291d2d85719039503f0c69fb2 WatchSource:0}: Error finding container 720545f529a6362ef5d7d234da098ebaa82b208291d2d85719039503f0c69fb2: Status 404 returned error can't find the container with id 720545f529a6362ef5d7d234da098ebaa82b208291d2d85719039503f0c69fb2
Jul 15 13:14:48.394143 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:48.394100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs" event={"ID":"e8c64e12-47a2-405d-b887-c0140cd5d4cf","Type":"ContainerStarted","Data":"720545f529a6362ef5d7d234da098ebaa82b208291d2d85719039503f0c69fb2"}
Jul 15 13:14:53.420938 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:53.420891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs" event={"ID":"e8c64e12-47a2-405d-b887-c0140cd5d4cf","Type":"ContainerStarted","Data":"4e8f304c1d9607f0324527c7aad423d3c18586a58acc8d06a58a6c65bbcd463e"}
Jul 15 13:14:54.429425 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:54.429382    2561 generic.go:356] "Generic (PLEG): container finished" podID="e8c64e12-47a2-405d-b887-c0140cd5d4cf" containerID="4e8f304c1d9607f0324527c7aad423d3c18586a58acc8d06a58a6c65bbcd463e" exitCode=0
Jul 15 13:14:54.429905 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:54.429431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs" event={"ID":"e8c64e12-47a2-405d-b887-c0140cd5d4cf","Type":"ContainerDied","Data":"4e8f304c1d9607f0324527c7aad423d3c18586a58acc8d06a58a6c65bbcd463e"}
Jul 15 13:14:56.440733 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:56.440692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs" event={"ID":"e8c64e12-47a2-405d-b887-c0140cd5d4cf","Type":"ContainerStarted","Data":"ee5fc25f6a0979fe17f99e874d8c74e373c621f5a18f770d808f53ba32664c97"}
Jul 15 13:14:56.441102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:56.440811    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:14:56.467979 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:14:56.467929    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs" podStartSLOduration=2.047460136 podStartE2EDuration="9.46791211s" totalImagesPullingTime="6.322313469s" totalInitContainerRuntime="1.098138505s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:14:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:14:56.465202164 +0000 UTC m=+505.414219636" watchObservedRunningTime="2026-07-15 13:14:56.46791211 +0000 UTC m=+505.416929581"
Jul 15 13:15:07.369931 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.369896    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"]
Jul 15 13:15:07.377895 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.377877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.382249 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.382214    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zxppv\""
Jul 15 13:15:07.382249 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.382233    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:15:07.382249 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.382251    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 13:15:07.382498 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.382262    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 13:15:07.382498 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.382260    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 13:15:07.382498 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.382214    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 13:15:07.392490 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.392464    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"]
Jul 15 13:15:07.444470 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.444434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzg2\" (UniqueName: \"kubernetes.io/projected/63253f9e-d65e-44f4-b59a-70b033d85ccb-kube-api-access-5tzg2\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.444470 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.444473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63253f9e-d65e-44f4-b59a-70b033d85ccb-manager-config\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.444670 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.444496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63253f9e-d65e-44f4-b59a-70b033d85ccb-cert\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.444670 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.444575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63253f9e-d65e-44f4-b59a-70b033d85ccb-metrics-cert\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.447140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.447113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-869c48857d-gbbhs"
Jul 15 13:15:07.545993 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.545964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63253f9e-d65e-44f4-b59a-70b033d85ccb-metrics-cert\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.546171 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.546047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzg2\" (UniqueName: \"kubernetes.io/projected/63253f9e-d65e-44f4-b59a-70b033d85ccb-kube-api-access-5tzg2\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.546171 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.546082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63253f9e-d65e-44f4-b59a-70b033d85ccb-manager-config\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.546171 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.546132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63253f9e-d65e-44f4-b59a-70b033d85ccb-cert\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.546839 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.546815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63253f9e-d65e-44f4-b59a-70b033d85ccb-manager-config\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.548713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.548686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63253f9e-d65e-44f4-b59a-70b033d85ccb-cert\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.548802 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.548686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63253f9e-d65e-44f4-b59a-70b033d85ccb-metrics-cert\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.558127 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.558092    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzg2\" (UniqueName: \"kubernetes.io/projected/63253f9e-d65e-44f4-b59a-70b033d85ccb-kube-api-access-5tzg2\") pod \"lws-controller-manager-8ddc6f8f9-p8gmb\" (UID: \"63253f9e-d65e-44f4-b59a-70b033d85ccb\") " pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.687105 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.687072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:07.819099 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:07.819072    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"]
Jul 15 13:15:07.821598 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:15:07.821570    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63253f9e_d65e_44f4_b59a_70b033d85ccb.slice/crio-8f73001afe1888360705f78ad613f615258c1477d65421bfc5fee323b267f081 WatchSource:0}: Error finding container 8f73001afe1888360705f78ad613f615258c1477d65421bfc5fee323b267f081: Status 404 returned error can't find the container with id 8f73001afe1888360705f78ad613f615258c1477d65421bfc5fee323b267f081
Jul 15 13:15:08.500296 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:08.500237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb" event={"ID":"63253f9e-d65e-44f4-b59a-70b033d85ccb","Type":"ContainerStarted","Data":"8f73001afe1888360705f78ad613f615258c1477d65421bfc5fee323b267f081"}
Jul 15 13:15:09.505970 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:09.505886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb" event={"ID":"63253f9e-d65e-44f4-b59a-70b033d85ccb","Type":"ContainerStarted","Data":"44ea16c1e5f830cef3874a6c0fc8899ad23e4697ae74e8b71c7807be35046b53"}
Jul 15 13:15:09.506351 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:09.506020    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:09.528527 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:09.528479    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb" podStartSLOduration=1.120572891 podStartE2EDuration="2.528458418s" totalImagesPullingTime="1.407885527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:09.525708231 +0000 UTC m=+518.474725702" watchObservedRunningTime="2026-07-15 13:15:09.528458418 +0000 UTC m=+518.477475888"
Jul 15 13:15:17.586994 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.586964    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"]
Jul 15 13:15:17.590904 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.590878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.593791 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.593763    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 13:15:17.594208 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.594087    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 13:15:17.594208 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.594126    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 13:15:17.594208 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.594138    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 13:15:17.594208 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.594167    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gs4ls\""
Jul 15 13:15:17.594467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.594451    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 13:15:17.595228 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.595051    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 13:15:17.606405 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.606377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"]
Jul 15 13:15:17.734342 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.734342 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.734563 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.734563 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j4zw\" (UniqueName: \"kubernetes.io/projected/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-kube-api-access-6j4zw\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.734669 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.734878 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.734878 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.734874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.835867 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.835825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.835867 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.835867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.836114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.835905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.836114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.835927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.836114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.835962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.836114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.835983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j4zw\" (UniqueName: \"kubernetes.io/projected/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-kube-api-access-6j4zw\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.836114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.836084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.836759 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.836731    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.838373 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.838309    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.838577 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.838555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.838642 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.838561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.838686 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.838657    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.851852 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.851826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.851947 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.851826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j4zw\" (UniqueName: \"kubernetes.io/projected/98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81-kube-api-access-6j4zw\") pod \"istiod-openshift-gateway-94bb8fbfd-s5mw5\" (UID: \"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:17.901097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:17.901059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:18.039675 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:18.039650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"]
Jul 15 13:15:18.040989 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:15:18.040961    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dcc4f7_110c_42e5_ab2d_ad2f6bf2ad81.slice/crio-08cd76142b8065b22543bda36427bb798c073c53d77c718aca1ef311bfbd2b74 WatchSource:0}: Error finding container 08cd76142b8065b22543bda36427bb798c073c53d77c718aca1ef311bfbd2b74: Status 404 returned error can't find the container with id 08cd76142b8065b22543bda36427bb798c073c53d77c718aca1ef311bfbd2b74
Jul 15 13:15:18.550013 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:18.549976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5" event={"ID":"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81","Type":"ContainerStarted","Data":"08cd76142b8065b22543bda36427bb798c073c53d77c718aca1ef311bfbd2b74"}
Jul 15 13:15:20.512421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:20.512393    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8ddc6f8f9-p8gmb"
Jul 15 13:15:21.836126 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:21.836079    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:15:21.836441 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:21.836157    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:15:22.574839 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:22.574766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5" event={"ID":"98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81","Type":"ContainerStarted","Data":"191d68ef0a924ed37e780fb2493544e6c05c2f318ac845160bf45e13297d096a"}
Jul 15 13:15:22.574999 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:22.574955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:15:22.576578 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:22.576553    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-s5mw5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 13:15:22.576719 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:22.576607    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5" podUID="98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:15:22.598875 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:22.598827    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5" podStartSLOduration=1.805968602 podStartE2EDuration="5.598812813s" totalImagesPullingTime="3.792844211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:22.59729473 +0000 UTC m=+531.546312204" watchObservedRunningTime="2026-07-15 13:15:22.598812813 +0000 UTC m=+531.547830284"
Jul 15 13:15:23.585065 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:15:23.585035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5mw5"
Jul 15 13:16:31.450326 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.450292    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:16:31.450891 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.450466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:16:31.452376 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.452350    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:16:31.452497 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.452489    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:16:31.460532 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.460511    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:16:31.460648 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.460567    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:16:31.905683 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.905558    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"]
Jul 15 13:16:31.909445 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.909428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:31.911945 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.911922    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 13:16:31.912812 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.912794    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 13:16:31.912865 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.912835    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dxsb\""
Jul 15 13:16:31.917269 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:31.917248    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"]
Jul 15 13:16:32.010935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.010904    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"]
Jul 15 13:16:32.014235 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.014217    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.022991 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.022961    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"]
Jul 15 13:16:32.047192 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.047165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.047349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.047211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwkz\" (UniqueName: \"kubernetes.io/projected/c02b0bb3-3518-4202-a1fd-a33c1820421b-kube-api-access-wvwkz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.047349 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.047240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.148057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.148057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjpw\" (UniqueName: \"kubernetes.io/projected/f0bb0cab-4907-4326-8be9-3c33477b27b6-kube-api-access-5fjpw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.148329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.148329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwkz\" (UniqueName: \"kubernetes.io/projected/c02b0bb3-3518-4202-a1fd-a33c1820421b-kube-api-access-wvwkz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.148329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.148329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.148582 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.148582 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.148572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.156764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.156703    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwkz\" (UniqueName: \"kubernetes.io/projected/c02b0bb3-3518-4202-a1fd-a33c1820421b-kube-api-access-wvwkz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.219768 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.219735    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:32.249254 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.249219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.249430 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.249353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.249430 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.249393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjpw\" (UniqueName: \"kubernetes.io/projected/f0bb0cab-4907-4326-8be9-3c33477b27b6-kube-api-access-5fjpw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.249656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.249630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.249779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.249676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.260529 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.260506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjpw\" (UniqueName: \"kubernetes.io/projected/f0bb0cab-4907-4326-8be9-3c33477b27b6-kube-api-access-5fjpw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.308922 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.308178    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"]
Jul 15 13:16:32.314842 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.314820    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.321334 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.321258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"]
Jul 15 13:16:32.324046 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.324026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:32.361713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.361689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"]
Jul 15 13:16:32.363924 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:16:32.363898    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02b0bb3_3518_4202_a1fd_a33c1820421b.slice/crio-dc2c1016f8cf304652147078ab2c492f9626818211c5fd734ebf1c8b2082cf3c WatchSource:0}: Error finding container dc2c1016f8cf304652147078ab2c492f9626818211c5fd734ebf1c8b2082cf3c: Status 404 returned error can't find the container with id dc2c1016f8cf304652147078ab2c492f9626818211c5fd734ebf1c8b2082cf3c
Jul 15 13:16:32.451466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.451427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8fd\" (UniqueName: \"kubernetes.io/projected/00b636ad-c615-4cb2-a2b5-f7b50b542834-kube-api-access-vs8fd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.451896 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.451475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.451896 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.451602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.468323 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.468295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"]
Jul 15 13:16:32.552916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.552893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8fd\" (UniqueName: \"kubernetes.io/projected/00b636ad-c615-4cb2-a2b5-f7b50b542834-kube-api-access-vs8fd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.553020 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.552928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.553020 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.552991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.553330 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.553312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.553377 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.553348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.560614 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.560592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8fd\" (UniqueName: \"kubernetes.io/projected/00b636ad-c615-4cb2-a2b5-f7b50b542834-kube-api-access-vs8fd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.625510 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.625478    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:32.707054 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.707024    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"]
Jul 15 13:16:32.710809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.710779    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.722152 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.722108    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"]
Jul 15 13:16:32.765754 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.765693    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"]
Jul 15 13:16:32.767841 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:16:32.767817    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b636ad_c615_4cb2_a2b5_f7b50b542834.slice/crio-5861f09f77f1707d3e6b40f4faed122ef8f72ceb8e907b00e3d2b3bcb779752c WatchSource:0}: Error finding container 5861f09f77f1707d3e6b40f4faed122ef8f72ceb8e907b00e3d2b3bcb779752c: Status 404 returned error can't find the container with id 5861f09f77f1707d3e6b40f4faed122ef8f72ceb8e907b00e3d2b3bcb779752c
Jul 15 13:16:32.856019 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.855987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.856019 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.856023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx8nb\" (UniqueName: \"kubernetes.io/projected/54222270-f846-4891-bd38-286842c332f7-kube-api-access-gx8nb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.856255 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.856054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.892625 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.892590    2561 generic.go:356] "Generic (PLEG): container finished" podID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerID="ab15e1fa078e0c49f7035df1c1b787f6bead7ca3e68da4bd0c466bfa5adee4af" exitCode=0
Jul 15 13:16:32.892783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.892667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g" event={"ID":"c02b0bb3-3518-4202-a1fd-a33c1820421b","Type":"ContainerDied","Data":"ab15e1fa078e0c49f7035df1c1b787f6bead7ca3e68da4bd0c466bfa5adee4af"}
Jul 15 13:16:32.892783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.892716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g" event={"ID":"c02b0bb3-3518-4202-a1fd-a33c1820421b","Type":"ContainerStarted","Data":"dc2c1016f8cf304652147078ab2c492f9626818211c5fd734ebf1c8b2082cf3c"}
Jul 15 13:16:32.893230 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.893214    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:16:32.894257 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.894236    2561 generic.go:356] "Generic (PLEG): container finished" podID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerID="58bd624d59722b2c7aa182f623b66555847a08ec7293f5489f0055c7e04bfbbd" exitCode=0
Jul 15 13:16:32.894382 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.894306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66" event={"ID":"00b636ad-c615-4cb2-a2b5-f7b50b542834","Type":"ContainerDied","Data":"58bd624d59722b2c7aa182f623b66555847a08ec7293f5489f0055c7e04bfbbd"}
Jul 15 13:16:32.894382 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.894345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66" event={"ID":"00b636ad-c615-4cb2-a2b5-f7b50b542834","Type":"ContainerStarted","Data":"5861f09f77f1707d3e6b40f4faed122ef8f72ceb8e907b00e3d2b3bcb779752c"}
Jul 15 13:16:32.895720 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.895702    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerID="f833a79e20d219d5b52a411b5b1b7aa7e6ffa965a0bb1ab70758b194379ea228" exitCode=0
Jul 15 13:16:32.895831 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.895774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs" event={"ID":"f0bb0cab-4907-4326-8be9-3c33477b27b6","Type":"ContainerDied","Data":"f833a79e20d219d5b52a411b5b1b7aa7e6ffa965a0bb1ab70758b194379ea228"}
Jul 15 13:16:32.895831 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.895810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs" event={"ID":"f0bb0cab-4907-4326-8be9-3c33477b27b6","Type":"ContainerStarted","Data":"51026796a95505a47c41dd622a9136ef059f95ab8577e9ec9aab2ee526a69105"}
Jul 15 13:16:32.957523 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.957445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.957523 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.957481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx8nb\" (UniqueName: \"kubernetes.io/projected/54222270-f846-4891-bd38-286842c332f7-kube-api-access-gx8nb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.957743 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.957522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.957943 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.957894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.958097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.957971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:32.965987 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:32.965962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx8nb\" (UniqueName: \"kubernetes.io/projected/54222270-f846-4891-bd38-286842c332f7-kube-api-access-gx8nb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:33.022988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.022951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:33.154832 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.154807    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"]
Jul 15 13:16:33.156806 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:16:33.156781    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54222270_f846_4891_bd38_286842c332f7.slice/crio-7e4d42d2bb6cea2734488b6529ef4020acb83f6989326da92cf997f769cace8f WatchSource:0}: Error finding container 7e4d42d2bb6cea2734488b6529ef4020acb83f6989326da92cf997f769cace8f: Status 404 returned error can't find the container with id 7e4d42d2bb6cea2734488b6529ef4020acb83f6989326da92cf997f769cace8f
Jul 15 13:16:33.902782 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.902752    2561 generic.go:356] "Generic (PLEG): container finished" podID="54222270-f846-4891-bd38-286842c332f7" containerID="1d3bb61b91155db2d09dcf6f0be76ad49186ec35e79941a9f2bdcef47fd7dad6" exitCode=0
Jul 15 13:16:33.903120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.902813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz" event={"ID":"54222270-f846-4891-bd38-286842c332f7","Type":"ContainerDied","Data":"1d3bb61b91155db2d09dcf6f0be76ad49186ec35e79941a9f2bdcef47fd7dad6"}
Jul 15 13:16:33.903120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.902865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz" event={"ID":"54222270-f846-4891-bd38-286842c332f7","Type":"ContainerStarted","Data":"7e4d42d2bb6cea2734488b6529ef4020acb83f6989326da92cf997f769cace8f"}
Jul 15 13:16:33.904768 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.904741    2561 generic.go:356] "Generic (PLEG): container finished" podID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerID="40616b459f71575b3790d25a6a784acd98e4ad56031d0d14618c2d76436bd1a6" exitCode=0
Jul 15 13:16:33.904875 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:33.904805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g" event={"ID":"c02b0bb3-3518-4202-a1fd-a33c1820421b","Type":"ContainerDied","Data":"40616b459f71575b3790d25a6a784acd98e4ad56031d0d14618c2d76436bd1a6"}
Jul 15 13:16:34.912051 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:34.912016    2561 generic.go:356] "Generic (PLEG): container finished" podID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerID="f2fe6292739fbed232ba6f891de1013c4a74ef8e4a3c2be962319d4fb95c6156" exitCode=0
Jul 15 13:16:34.912458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:34.912085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g" event={"ID":"c02b0bb3-3518-4202-a1fd-a33c1820421b","Type":"ContainerDied","Data":"f2fe6292739fbed232ba6f891de1013c4a74ef8e4a3c2be962319d4fb95c6156"}
Jul 15 13:16:34.913829 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:34.913801    2561 generic.go:356] "Generic (PLEG): container finished" podID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerID="253506a8381a56b132e8e72303b9548115b81991088b3c396486b0fb0c13b3f7" exitCode=0
Jul 15 13:16:34.913973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:34.913891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66" event={"ID":"00b636ad-c615-4cb2-a2b5-f7b50b542834","Type":"ContainerDied","Data":"253506a8381a56b132e8e72303b9548115b81991088b3c396486b0fb0c13b3f7"}
Jul 15 13:16:34.915724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:34.915694    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerID="8c85ceae7f0ab6a77576e9ba6a1a564faede175a5160deb6ff030cc04f06a63e" exitCode=0
Jul 15 13:16:34.915814 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:34.915801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs" event={"ID":"f0bb0cab-4907-4326-8be9-3c33477b27b6","Type":"ContainerDied","Data":"8c85ceae7f0ab6a77576e9ba6a1a564faede175a5160deb6ff030cc04f06a63e"}
Jul 15 13:16:35.923602 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:35.923571    2561 generic.go:356] "Generic (PLEG): container finished" podID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerID="d2e9ac3bd38fba01a55af2a9f1379e0cd8bf0db218c3d219913485f6cc1f5482" exitCode=0
Jul 15 13:16:35.924013 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:35.923643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66" event={"ID":"00b636ad-c615-4cb2-a2b5-f7b50b542834","Type":"ContainerDied","Data":"d2e9ac3bd38fba01a55af2a9f1379e0cd8bf0db218c3d219913485f6cc1f5482"}
Jul 15 13:16:35.925478 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:35.925453    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerID="adf9913428042439eb8db5210b056a105508d92d1bb7f79e8bbccb17f4669c10" exitCode=0
Jul 15 13:16:35.925613 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:35.925540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs" event={"ID":"f0bb0cab-4907-4326-8be9-3c33477b27b6","Type":"ContainerDied","Data":"adf9913428042439eb8db5210b056a105508d92d1bb7f79e8bbccb17f4669c10"}
Jul 15 13:16:35.927218 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:35.927199    2561 generic.go:356] "Generic (PLEG): container finished" podID="54222270-f846-4891-bd38-286842c332f7" containerID="d7338baa88ee2c9dd699e60a7f4abf9511ef2cb5345397be3129f0ba85bdf32a" exitCode=0
Jul 15 13:16:35.927343 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:35.927225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz" event={"ID":"54222270-f846-4891-bd38-286842c332f7","Type":"ContainerDied","Data":"d7338baa88ee2c9dd699e60a7f4abf9511ef2cb5345397be3129f0ba85bdf32a"}
Jul 15 13:16:36.067979 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.067951    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:36.185660 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.185628    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-bundle\") pod \"c02b0bb3-3518-4202-a1fd-a33c1820421b\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") "
Jul 15 13:16:36.185831 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.185676    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-util\") pod \"c02b0bb3-3518-4202-a1fd-a33c1820421b\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") "
Jul 15 13:16:36.185831 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.185703    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvwkz\" (UniqueName: \"kubernetes.io/projected/c02b0bb3-3518-4202-a1fd-a33c1820421b-kube-api-access-wvwkz\") pod \"c02b0bb3-3518-4202-a1fd-a33c1820421b\" (UID: \"c02b0bb3-3518-4202-a1fd-a33c1820421b\") "
Jul 15 13:16:36.186468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.186431    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-bundle" (OuterVolumeSpecName: "bundle") pod "c02b0bb3-3518-4202-a1fd-a33c1820421b" (UID: "c02b0bb3-3518-4202-a1fd-a33c1820421b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:36.187955 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.187925    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c02b0bb3-3518-4202-a1fd-a33c1820421b-kube-api-access-wvwkz" (OuterVolumeSpecName: "kube-api-access-wvwkz") pod "c02b0bb3-3518-4202-a1fd-a33c1820421b" (UID: "c02b0bb3-3518-4202-a1fd-a33c1820421b"). InnerVolumeSpecName "kube-api-access-wvwkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:36.191176 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.191157    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-util" (OuterVolumeSpecName: "util") pod "c02b0bb3-3518-4202-a1fd-a33c1820421b" (UID: "c02b0bb3-3518-4202-a1fd-a33c1820421b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:36.287194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.287150    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:36.287194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.287181    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02b0bb3-3518-4202-a1fd-a33c1820421b-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:36.287194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.287191    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvwkz\" (UniqueName: \"kubernetes.io/projected/c02b0bb3-3518-4202-a1fd-a33c1820421b-kube-api-access-wvwkz\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:36.934737 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.934697    2561 generic.go:356] "Generic (PLEG): container finished" podID="54222270-f846-4891-bd38-286842c332f7" containerID="465acf9a7078736e6e166ff2be153ceb50e81d148008235f1e67d40436a9a959" exitCode=0
Jul 15 13:16:36.935125 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.934782    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz" event={"ID":"54222270-f846-4891-bd38-286842c332f7","Type":"ContainerDied","Data":"465acf9a7078736e6e166ff2be153ceb50e81d148008235f1e67d40436a9a959"}
Jul 15 13:16:36.936665 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.936648    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g"
Jul 15 13:16:36.936727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.936686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g" event={"ID":"c02b0bb3-3518-4202-a1fd-a33c1820421b","Type":"ContainerDied","Data":"dc2c1016f8cf304652147078ab2c492f9626818211c5fd734ebf1c8b2082cf3c"}
Jul 15 13:16:36.936727 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:36.936725    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc2c1016f8cf304652147078ab2c492f9626818211c5fd734ebf1c8b2082cf3c"
Jul 15 13:16:37.067861 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.067836    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:37.103529 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.103499    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:37.195120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.195032    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-util\") pod \"00b636ad-c615-4cb2-a2b5-f7b50b542834\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") "
Jul 15 13:16:37.195120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.195094    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-bundle\") pod \"00b636ad-c615-4cb2-a2b5-f7b50b542834\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") "
Jul 15 13:16:37.195327 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.195189    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs8fd\" (UniqueName: \"kubernetes.io/projected/00b636ad-c615-4cb2-a2b5-f7b50b542834-kube-api-access-vs8fd\") pod \"00b636ad-c615-4cb2-a2b5-f7b50b542834\" (UID: \"00b636ad-c615-4cb2-a2b5-f7b50b542834\") "
Jul 15 13:16:37.195519 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.195493    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-bundle" (OuterVolumeSpecName: "bundle") pod "00b636ad-c615-4cb2-a2b5-f7b50b542834" (UID: "00b636ad-c615-4cb2-a2b5-f7b50b542834"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:37.197244 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.197219    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b636ad-c615-4cb2-a2b5-f7b50b542834-kube-api-access-vs8fd" (OuterVolumeSpecName: "kube-api-access-vs8fd") pod "00b636ad-c615-4cb2-a2b5-f7b50b542834" (UID: "00b636ad-c615-4cb2-a2b5-f7b50b542834"). InnerVolumeSpecName "kube-api-access-vs8fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:37.200434 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.200412    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-util" (OuterVolumeSpecName: "util") pod "00b636ad-c615-4cb2-a2b5-f7b50b542834" (UID: "00b636ad-c615-4cb2-a2b5-f7b50b542834"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:37.296335 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296266    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fjpw\" (UniqueName: \"kubernetes.io/projected/f0bb0cab-4907-4326-8be9-3c33477b27b6-kube-api-access-5fjpw\") pod \"f0bb0cab-4907-4326-8be9-3c33477b27b6\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") "
Jul 15 13:16:37.296517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-util\") pod \"f0bb0cab-4907-4326-8be9-3c33477b27b6\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") "
Jul 15 13:16:37.296517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-bundle\") pod \"f0bb0cab-4907-4326-8be9-3c33477b27b6\" (UID: \"f0bb0cab-4907-4326-8be9-3c33477b27b6\") "
Jul 15 13:16:37.296651 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296631    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs8fd\" (UniqueName: \"kubernetes.io/projected/00b636ad-c615-4cb2-a2b5-f7b50b542834-kube-api-access-vs8fd\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:37.296715 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296654    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:37.296715 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296668    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b636ad-c615-4cb2-a2b5-f7b50b542834-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:37.296987 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.296961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-bundle" (OuterVolumeSpecName: "bundle") pod "f0bb0cab-4907-4326-8be9-3c33477b27b6" (UID: "f0bb0cab-4907-4326-8be9-3c33477b27b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:37.298531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.298507    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0bb0cab-4907-4326-8be9-3c33477b27b6-kube-api-access-5fjpw" (OuterVolumeSpecName: "kube-api-access-5fjpw") pod "f0bb0cab-4907-4326-8be9-3c33477b27b6" (UID: "f0bb0cab-4907-4326-8be9-3c33477b27b6"). InnerVolumeSpecName "kube-api-access-5fjpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:37.304314 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.304267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-util" (OuterVolumeSpecName: "util") pod "f0bb0cab-4907-4326-8be9-3c33477b27b6" (UID: "f0bb0cab-4907-4326-8be9-3c33477b27b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:37.398067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.398031    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fjpw\" (UniqueName: \"kubernetes.io/projected/f0bb0cab-4907-4326-8be9-3c33477b27b6-kube-api-access-5fjpw\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:37.398067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.398059    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:37.398067 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.398070    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0bb0cab-4907-4326-8be9-3c33477b27b6-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:37.943930 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.943902    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66"
Jul 15 13:16:37.944387 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.943891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66" event={"ID":"00b636ad-c615-4cb2-a2b5-f7b50b542834","Type":"ContainerDied","Data":"5861f09f77f1707d3e6b40f4faed122ef8f72ceb8e907b00e3d2b3bcb779752c"}
Jul 15 13:16:37.944387 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.943981    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5861f09f77f1707d3e6b40f4faed122ef8f72ceb8e907b00e3d2b3bcb779752c"
Jul 15 13:16:37.945995 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.945977    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs"
Jul 15 13:16:37.946149 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.946010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs" event={"ID":"f0bb0cab-4907-4326-8be9-3c33477b27b6","Type":"ContainerDied","Data":"51026796a95505a47c41dd622a9136ef059f95ab8577e9ec9aab2ee526a69105"}
Jul 15 13:16:37.946149 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:37.946097    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51026796a95505a47c41dd622a9136ef059f95ab8577e9ec9aab2ee526a69105"
Jul 15 13:16:38.078846 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.078821    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:38.104223 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.104182    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx8nb\" (UniqueName: \"kubernetes.io/projected/54222270-f846-4891-bd38-286842c332f7-kube-api-access-gx8nb\") pod \"54222270-f846-4891-bd38-286842c332f7\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") "
Jul 15 13:16:38.104426 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.104231    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-bundle\") pod \"54222270-f846-4891-bd38-286842c332f7\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") "
Jul 15 13:16:38.104426 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.104257    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-util\") pod \"54222270-f846-4891-bd38-286842c332f7\" (UID: \"54222270-f846-4891-bd38-286842c332f7\") "
Jul 15 13:16:38.104723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.104700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-bundle" (OuterVolumeSpecName: "bundle") pod "54222270-f846-4891-bd38-286842c332f7" (UID: "54222270-f846-4891-bd38-286842c332f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:38.110338 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.110307    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54222270-f846-4891-bd38-286842c332f7-kube-api-access-gx8nb" (OuterVolumeSpecName: "kube-api-access-gx8nb") pod "54222270-f846-4891-bd38-286842c332f7" (UID: "54222270-f846-4891-bd38-286842c332f7"). InnerVolumeSpecName "kube-api-access-gx8nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:38.112255 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.112226    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-util" (OuterVolumeSpecName: "util") pod "54222270-f846-4891-bd38-286842c332f7" (UID: "54222270-f846-4891-bd38-286842c332f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:38.205634 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.205553    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:38.205634 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.205581    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54222270-f846-4891-bd38-286842c332f7-util\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:38.205634 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.205590    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx8nb\" (UniqueName: \"kubernetes.io/projected/54222270-f846-4891-bd38-286842c332f7-kube-api-access-gx8nb\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:16:38.952386 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.952352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz" event={"ID":"54222270-f846-4891-bd38-286842c332f7","Type":"ContainerDied","Data":"7e4d42d2bb6cea2734488b6529ef4020acb83f6989326da92cf997f769cace8f"}
Jul 15 13:16:38.952386 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.952385    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz"
Jul 15 13:16:38.952781 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:16:38.952405    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e4d42d2bb6cea2734488b6529ef4020acb83f6989326da92cf997f769cace8f"
Jul 15 13:17:00.229716 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:00.229670    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669cc46998-t4rlp"]
Jul 15 13:17:08.979312 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979259    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"]
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979584    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979596    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979605    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979611    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979618    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979624    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979634    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979641    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979649    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979654    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979661    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979665    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979673    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979678    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="util"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979683    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979688    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979697    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979702    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="extract"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979708    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979712    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979719    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979730    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979734    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="pull"
Jul 15 13:17:08.979776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979788    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54222270-f846-4891-bd38-286842c332f7" containerName="extract"
Jul 15 13:17:08.980505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979796    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b636ad-c615-4cb2-a2b5-f7b50b542834" containerName="extract"
Jul 15 13:17:08.980505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979802    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c02b0bb3-3518-4202-a1fd-a33c1820421b" containerName="extract"
Jul 15 13:17:08.980505 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.979808    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0bb0cab-4907-4326-8be9-3c33477b27b6" containerName="extract"
Jul 15 13:17:08.984397 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:08.984376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.000582 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.000554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 13:17:09.000887 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.000869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 13:17:09.000933 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.000870    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fnrbn\""
Jul 15 13:17:09.008725 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.008696    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"]
Jul 15 13:17:09.079311 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.079255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3638a07e-2251-47fe-9af1-eaa93f396696-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.079486 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.079330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4km7\" (UniqueName: \"kubernetes.io/projected/3638a07e-2251-47fe-9af1-eaa93f396696-kube-api-access-v4km7\") pod \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.180226 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.180188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3638a07e-2251-47fe-9af1-eaa93f396696-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.180226 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.180232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4km7\" (UniqueName: \"kubernetes.io/projected/3638a07e-2251-47fe-9af1-eaa93f396696-kube-api-access-v4km7\") pod \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.180687 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.180661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3638a07e-2251-47fe-9af1-eaa93f396696-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.189681 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.189662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4km7\" (UniqueName: \"kubernetes.io/projected/3638a07e-2251-47fe-9af1-eaa93f396696-kube-api-access-v4km7\") pod \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.293996 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.293909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.418133 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.418088    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"]
Jul 15 13:17:09.426870 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.426842    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"]
Jul 15 13:17:09.442664 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.442630    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"]
Jul 15 13:17:09.447683 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.447656    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.462191 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.462159    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"]
Jul 15 13:17:09.548776 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:09.548746    2561 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 15 13:17:09.548776 ip-10-0-143-224 kubenswrapper[2561]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-f9vzw_kuadrant-system_3638a07e-2251-47fe-9af1-eaa93f396696_0(fa5003dca75efe6b16e8ef5cb32e6b16ba82a2931a6046ef746dafc87cb7f35b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-f9vzw to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"fa5003dca75efe6b16e8ef5cb32e6b16ba82a2931a6046ef746dafc87cb7f35b" Netns:"/var/run/netns/5496b414-a029-45a1-ad81-ef98b35f96fa" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-f9vzw;K8S_POD_INFRA_CONTAINER_ID=fa5003dca75efe6b16e8ef5cb32e6b16ba82a2931a6046ef746dafc87cb7f35b;K8S_POD_UID=3638a07e-2251-47fe-9af1-eaa93f396696" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw/3638a07e-2251-47fe-9af1-eaa93f396696]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-f9vzw in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-f9vzw in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw: pods "kuadrant-operator-controller-manager-55467d9f7-f9vzw" not found
Jul 15 13:17:09.548776 ip-10-0-143-224 kubenswrapper[2561]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 15 13:17:09.548776 ip-10-0-143-224 kubenswrapper[2561]:  >
Jul 15 13:17:09.548930 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:09.548804    2561 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 15 13:17:09.548930 ip-10-0-143-224 kubenswrapper[2561]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-f9vzw_kuadrant-system_3638a07e-2251-47fe-9af1-eaa93f396696_0(fa5003dca75efe6b16e8ef5cb32e6b16ba82a2931a6046ef746dafc87cb7f35b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-f9vzw to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"fa5003dca75efe6b16e8ef5cb32e6b16ba82a2931a6046ef746dafc87cb7f35b" Netns:"/var/run/netns/5496b414-a029-45a1-ad81-ef98b35f96fa" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-f9vzw;K8S_POD_INFRA_CONTAINER_ID=fa5003dca75efe6b16e8ef5cb32e6b16ba82a2931a6046ef746dafc87cb7f35b;K8S_POD_UID=3638a07e-2251-47fe-9af1-eaa93f396696" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw/3638a07e-2251-47fe-9af1-eaa93f396696]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-f9vzw in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-f9vzw in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw: pods "kuadrant-operator-controller-manager-55467d9f7-f9vzw" not found
Jul 15 13:17:09.548930 ip-10-0-143-224 kubenswrapper[2561]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 15 13:17:09.548930 ip-10-0-143-224 kubenswrapper[2561]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:09.583843 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.583809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5285624-7cd5-4585-a9f5-a3a295088a28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qhlsb\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.583843 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.583846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vx79\" (UniqueName: \"kubernetes.io/projected/d5285624-7cd5-4585-a9f5-a3a295088a28-kube-api-access-7vx79\") pod \"kuadrant-operator-controller-manager-55467d9f7-qhlsb\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.684290 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.684250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5285624-7cd5-4585-a9f5-a3a295088a28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qhlsb\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.684472 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.684324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vx79\" (UniqueName: \"kubernetes.io/projected/d5285624-7cd5-4585-a9f5-a3a295088a28-kube-api-access-7vx79\") pod \"kuadrant-operator-controller-manager-55467d9f7-qhlsb\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.684694 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.684652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5285624-7cd5-4585-a9f5-a3a295088a28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qhlsb\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.693389 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.693362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vx79\" (UniqueName: \"kubernetes.io/projected/d5285624-7cd5-4585-a9f5-a3a295088a28-kube-api-access-7vx79\") pod \"kuadrant-operator-controller-manager-55467d9f7-qhlsb\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.760517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.760479    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:09.915767 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:09.915740    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"]
Jul 15 13:17:09.918192 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:17:09.918165    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5285624_7cd5_4585_a9f5_a3a295088a28.slice/crio-20539c5a3e7db25b7172c496aa6d60fe734a5085e7ccb6e4e199df5bd42552b4 WatchSource:0}: Error finding container 20539c5a3e7db25b7172c496aa6d60fe734a5085e7ccb6e4e199df5bd42552b4: Status 404 returned error can't find the container with id 20539c5a3e7db25b7172c496aa6d60fe734a5085e7ccb6e4e199df5bd42552b4
Jul 15 13:17:10.104990 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.104900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb" event={"ID":"d5285624-7cd5-4585-a9f5-a3a295088a28","Type":"ContainerStarted","Data":"20539c5a3e7db25b7172c496aa6d60fe734a5085e7ccb6e4e199df5bd42552b4"}
Jul 15 13:17:10.104990 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.104941    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:10.112682 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.112659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:10.115155 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:10.115131    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="3638a07e-2251-47fe-9af1-eaa93f396696" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:10.189424 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.189388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4km7\" (UniqueName: \"kubernetes.io/projected/3638a07e-2251-47fe-9af1-eaa93f396696-kube-api-access-v4km7\") pod \"3638a07e-2251-47fe-9af1-eaa93f396696\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") "
Jul 15 13:17:10.189582 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.189508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3638a07e-2251-47fe-9af1-eaa93f396696-extensions-socket-volume\") pod \"3638a07e-2251-47fe-9af1-eaa93f396696\" (UID: \"3638a07e-2251-47fe-9af1-eaa93f396696\") "
Jul 15 13:17:10.189795 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.189770    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3638a07e-2251-47fe-9af1-eaa93f396696-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3638a07e-2251-47fe-9af1-eaa93f396696" (UID: "3638a07e-2251-47fe-9af1-eaa93f396696"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:17:10.191491 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.191467    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3638a07e-2251-47fe-9af1-eaa93f396696-kube-api-access-v4km7" (OuterVolumeSpecName: "kube-api-access-v4km7") pod "3638a07e-2251-47fe-9af1-eaa93f396696" (UID: "3638a07e-2251-47fe-9af1-eaa93f396696"). InnerVolumeSpecName "kube-api-access-v4km7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:17:10.290609 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.290572    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3638a07e-2251-47fe-9af1-eaa93f396696-extensions-socket-volume\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:10.290609 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:10.290602    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4km7\" (UniqueName: \"kubernetes.io/projected/3638a07e-2251-47fe-9af1-eaa93f396696-kube-api-access-v4km7\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:11.109581 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:11.109550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:11.111938 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:11.111911    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="3638a07e-2251-47fe-9af1-eaa93f396696" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:11.117351 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:11.117322    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="3638a07e-2251-47fe-9af1-eaa93f396696" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:11.585194 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:11.585153    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f9vzw\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="3638a07e-2251-47fe-9af1-eaa93f396696" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f9vzw"
Jul 15 13:17:11.586905 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:11.586876    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3638a07e-2251-47fe-9af1-eaa93f396696" path="/var/lib/kubelet/pods/3638a07e-2251-47fe-9af1-eaa93f396696/volumes"
Jul 15 13:17:17.143986 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:17.143952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb" event={"ID":"d5285624-7cd5-4585-a9f5-a3a295088a28","Type":"ContainerStarted","Data":"bb2d21b2d861d7d3dc5ef0ef04d4ee37656cce25c7c47191571546cab7777720"}
Jul 15 13:17:17.144458 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:17.144057    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:17.166695 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:17.166642    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb" podStartSLOduration=1.886675587 podStartE2EDuration="8.166626811s" totalImagesPullingTime="6.279951224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:17.164840886 +0000 UTC m=+646.113858356" watchObservedRunningTime="2026-07-15 13:17:17.166626811 +0000 UTC m=+646.115644281"
Jul 15 13:17:25.258442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.258400    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-669cc46998-t4rlp" podUID="5997acfd-093d-4162-84db-994df90ae5a5" containerName="console" containerID="cri-o://822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2" gracePeriod=15
Jul 15 13:17:25.509083 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.509014    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:17:25.521633 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521610    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjps6\" (UniqueName: \"kubernetes.io/projected/5997acfd-093d-4162-84db-994df90ae5a5-kube-api-access-zjps6\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.521777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521659    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-serving-cert\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.521777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521684    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-oauth-config\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.521777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521762    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-service-ca\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.521935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-oauth-serving-cert\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.521935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521835    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-console-config\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.521935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.521868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-trusted-ca-bundle\") pod \"5997acfd-093d-4162-84db-994df90ae5a5\" (UID: \"5997acfd-093d-4162-84db-994df90ae5a5\") "
Jul 15 13:17:25.522261 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.522191    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:17:25.522384 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.522311    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-console-config" (OuterVolumeSpecName: "console-config") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:17:25.522384 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.522202    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:17:25.522494 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.522445    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:17:25.523762 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.523737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:17:25.523858 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.523812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5997acfd-093d-4162-84db-994df90ae5a5-kube-api-access-zjps6" (OuterVolumeSpecName: "kube-api-access-zjps6") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "kube-api-access-zjps6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:17:25.523858 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.523829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5997acfd-093d-4162-84db-994df90ae5a5" (UID: "5997acfd-093d-4162-84db-994df90ae5a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:17:25.623457 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623418    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjps6\" (UniqueName: \"kubernetes.io/projected/5997acfd-093d-4162-84db-994df90ae5a5-kube-api-access-zjps6\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:25.623457 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623455    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:25.623457 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623468    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5997acfd-093d-4162-84db-994df90ae5a5-console-oauth-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:25.623457 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623478    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:25.623724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623486    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-oauth-serving-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:25.623724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623495    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-console-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:25.623724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:25.623503    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5997acfd-093d-4162-84db-994df90ae5a5-trusted-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:26.190323 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.190284    2561 generic.go:356] "Generic (PLEG): container finished" podID="5997acfd-093d-4162-84db-994df90ae5a5" containerID="822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2" exitCode=0
Jul 15 13:17:26.190500 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.190336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669cc46998-t4rlp" event={"ID":"5997acfd-093d-4162-84db-994df90ae5a5","Type":"ContainerDied","Data":"822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2"}
Jul 15 13:17:26.190500 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.190348    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669cc46998-t4rlp"
Jul 15 13:17:26.190500 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.190387    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669cc46998-t4rlp" event={"ID":"5997acfd-093d-4162-84db-994df90ae5a5","Type":"ContainerDied","Data":"456b285a71f2a83a88977b0000e282c11f22f52cc188b1887baff4fdc59a182e"}
Jul 15 13:17:26.190500 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.190412    2561 scope.go:117] "RemoveContainer" containerID="822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2"
Jul 15 13:17:26.199380 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.199359    2561 scope.go:117] "RemoveContainer" containerID="822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2"
Jul 15 13:17:26.199655 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:17:26.199633    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2\": container with ID starting with 822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2 not found: ID does not exist" containerID="822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2"
Jul 15 13:17:26.199705 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.199664    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2"} err="failed to get container status \"822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2\": rpc error: code = NotFound desc = could not find container \"822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2\": container with ID starting with 822916b9e68e6997d16a16975a698190bf4b6e57673e61ac4ca8ae7105ec99e2 not found: ID does not exist"
Jul 15 13:17:26.209629 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.209602    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669cc46998-t4rlp"]
Jul 15 13:17:26.213494 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:26.213472    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-669cc46998-t4rlp"]
Jul 15 13:17:27.584591 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:27.584559    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5997acfd-093d-4162-84db-994df90ae5a5" path="/var/lib/kubelet/pods/5997acfd-093d-4162-84db-994df90ae5a5/volumes"
Jul 15 13:17:28.151397 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:28.151360    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:41.069010 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.068975    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"]
Jul 15 13:17:41.069820 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.069173    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb" podUID="d5285624-7cd5-4585-a9f5-a3a295088a28" containerName="manager" containerID="cri-o://bb2d21b2d861d7d3dc5ef0ef04d4ee37656cce25c7c47191571546cab7777720" gracePeriod=10
Jul 15 13:17:41.275669 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.275634    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5285624-7cd5-4585-a9f5-a3a295088a28" containerID="bb2d21b2d861d7d3dc5ef0ef04d4ee37656cce25c7c47191571546cab7777720" exitCode=0
Jul 15 13:17:41.275820 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.275700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb" event={"ID":"d5285624-7cd5-4585-a9f5-a3a295088a28","Type":"ContainerDied","Data":"bb2d21b2d861d7d3dc5ef0ef04d4ee37656cce25c7c47191571546cab7777720"}
Jul 15 13:17:41.316528 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.316490    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:41.351953 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.351886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5285624-7cd5-4585-a9f5-a3a295088a28-extensions-socket-volume\") pod \"d5285624-7cd5-4585-a9f5-a3a295088a28\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") "
Jul 15 13:17:41.351953 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.351919    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vx79\" (UniqueName: \"kubernetes.io/projected/d5285624-7cd5-4585-a9f5-a3a295088a28-kube-api-access-7vx79\") pod \"d5285624-7cd5-4585-a9f5-a3a295088a28\" (UID: \"d5285624-7cd5-4585-a9f5-a3a295088a28\") "
Jul 15 13:17:41.352354 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.352323    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5285624-7cd5-4585-a9f5-a3a295088a28-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d5285624-7cd5-4585-a9f5-a3a295088a28" (UID: "d5285624-7cd5-4585-a9f5-a3a295088a28"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:17:41.354100 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.354072    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5285624-7cd5-4585-a9f5-a3a295088a28-kube-api-access-7vx79" (OuterVolumeSpecName: "kube-api-access-7vx79") pod "d5285624-7cd5-4585-a9f5-a3a295088a28" (UID: "d5285624-7cd5-4585-a9f5-a3a295088a28"). InnerVolumeSpecName "kube-api-access-7vx79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:17:41.452640 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.452604    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5285624-7cd5-4585-a9f5-a3a295088a28-extensions-socket-volume\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:41.452640 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:41.452634    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vx79\" (UniqueName: \"kubernetes.io/projected/d5285624-7cd5-4585-a9f5-a3a295088a28-kube-api-access-7vx79\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:17:42.281971 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:42.281945    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"
Jul 15 13:17:42.282424 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:42.281936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb" event={"ID":"d5285624-7cd5-4585-a9f5-a3a295088a28","Type":"ContainerDied","Data":"20539c5a3e7db25b7172c496aa6d60fe734a5085e7ccb6e4e199df5bd42552b4"}
Jul 15 13:17:42.282424 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:42.282083    2561 scope.go:117] "RemoveContainer" containerID="bb2d21b2d861d7d3dc5ef0ef04d4ee37656cce25c7c47191571546cab7777720"
Jul 15 13:17:42.304558 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:42.304533    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"]
Jul 15 13:17:42.317566 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:42.317534    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qhlsb"]
Jul 15 13:17:43.584676 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:17:43.584646    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5285624-7cd5-4585-a9f5-a3a295088a28" path="/var/lib/kubelet/pods/d5285624-7cd5-4585-a9f5-a3a295088a28/volumes"
Jul 15 13:18:00.027072 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027034    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:00.027462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027346    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5997acfd-093d-4162-84db-994df90ae5a5" containerName="console"
Jul 15 13:18:00.027462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027357    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5997acfd-093d-4162-84db-994df90ae5a5" containerName="console"
Jul 15 13:18:00.027462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027370    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5285624-7cd5-4585-a9f5-a3a295088a28" containerName="manager"
Jul 15 13:18:00.027462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027376    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5285624-7cd5-4585-a9f5-a3a295088a28" containerName="manager"
Jul 15 13:18:00.027462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027433    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5997acfd-093d-4162-84db-994df90ae5a5" containerName="console"
Jul 15 13:18:00.027462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.027441    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5285624-7cd5-4585-a9f5-a3a295088a28" containerName="manager"
Jul 15 13:18:00.030186 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.030169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.033090 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.033064    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 13:18:00.033210 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.033064    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 13:18:00.033210 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.033074    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 13:18:00.033973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.033960    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dxsb\""
Jul 15 13:18:00.040259 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.040235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:00.120229 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.120193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4r2d\" (UniqueName: \"kubernetes.io/projected/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-kube-api-access-f4r2d\") pod \"limitador-limitador-64c94fd64f-2q6t5\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.120420 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.120245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-config-file\") pod \"limitador-limitador-64c94fd64f-2q6t5\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.122721 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.122698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:00.221160 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.221127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4r2d\" (UniqueName: \"kubernetes.io/projected/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-kube-api-access-f4r2d\") pod \"limitador-limitador-64c94fd64f-2q6t5\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.221346 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.221180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-config-file\") pod \"limitador-limitador-64c94fd64f-2q6t5\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.221788 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.221767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-config-file\") pod \"limitador-limitador-64c94fd64f-2q6t5\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.229769 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.229740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4r2d\" (UniqueName: \"kubernetes.io/projected/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-kube-api-access-f4r2d\") pod \"limitador-limitador-64c94fd64f-2q6t5\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.341297 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.341207    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:00.479752 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:00.479667    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:00.481913 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:18:00.481885    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3f4475_d3cd_45d4_92de_bfb10920e0c0.slice/crio-9afe8f3fef7976adfb2c0a2ff6a79ce42baefb2515839d1e5e2cc83ab3018b9a WatchSource:0}: Error finding container 9afe8f3fef7976adfb2c0a2ff6a79ce42baefb2515839d1e5e2cc83ab3018b9a: Status 404 returned error can't find the container with id 9afe8f3fef7976adfb2c0a2ff6a79ce42baefb2515839d1e5e2cc83ab3018b9a
Jul 15 13:18:01.382965 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:01.382885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5" event={"ID":"bb3f4475-d3cd-45d4-92de-bfb10920e0c0","Type":"ContainerStarted","Data":"9afe8f3fef7976adfb2c0a2ff6a79ce42baefb2515839d1e5e2cc83ab3018b9a"}
Jul 15 13:18:03.395404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:03.395361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5" event={"ID":"bb3f4475-d3cd-45d4-92de-bfb10920e0c0","Type":"ContainerStarted","Data":"0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b"}
Jul 15 13:18:03.395880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:03.395466    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:03.416798 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:03.416750    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5" podStartSLOduration=0.658263439 podStartE2EDuration="3.416732677s" totalImagesPullingTime="2.758469238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:18:03.414523617 +0000 UTC m=+692.363541111" watchObservedRunningTime="2026-07-15 13:18:03.416732677 +0000 UTC m=+692.365750186"
Jul 15 13:18:14.400315 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:14.400266    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:15.101053 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.101015    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:15.101255 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.101227    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5" podUID="bb3f4475-d3cd-45d4-92de-bfb10920e0c0" containerName="limitador" containerID="cri-o://0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b" gracePeriod=30
Jul 15 13:18:15.649082 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.649056    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:15.753966 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.753927    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4r2d\" (UniqueName: \"kubernetes.io/projected/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-kube-api-access-f4r2d\") pod \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") "
Jul 15 13:18:15.754178 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.753974    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-config-file\") pod \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\" (UID: \"bb3f4475-d3cd-45d4-92de-bfb10920e0c0\") "
Jul 15 13:18:15.754390 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.754359    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-config-file" (OuterVolumeSpecName: "config-file") pod "bb3f4475-d3cd-45d4-92de-bfb10920e0c0" (UID: "bb3f4475-d3cd-45d4-92de-bfb10920e0c0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:18:15.756020 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.755999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-kube-api-access-f4r2d" (OuterVolumeSpecName: "kube-api-access-f4r2d") pod "bb3f4475-d3cd-45d4-92de-bfb10920e0c0" (UID: "bb3f4475-d3cd-45d4-92de-bfb10920e0c0"). InnerVolumeSpecName "kube-api-access-f4r2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:18:15.854705 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.854651    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4r2d\" (UniqueName: \"kubernetes.io/projected/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-kube-api-access-f4r2d\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:18:15.854705 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:15.854697    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb3f4475-d3cd-45d4-92de-bfb10920e0c0-config-file\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:18:16.460747 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.460710    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb3f4475-d3cd-45d4-92de-bfb10920e0c0" containerID="0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b" exitCode=0
Jul 15 13:18:16.460911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.460757    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"
Jul 15 13:18:16.460911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.460780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5" event={"ID":"bb3f4475-d3cd-45d4-92de-bfb10920e0c0","Type":"ContainerDied","Data":"0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b"}
Jul 15 13:18:16.460911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.460830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2q6t5" event={"ID":"bb3f4475-d3cd-45d4-92de-bfb10920e0c0","Type":"ContainerDied","Data":"9afe8f3fef7976adfb2c0a2ff6a79ce42baefb2515839d1e5e2cc83ab3018b9a"}
Jul 15 13:18:16.460911 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.460860    2561 scope.go:117] "RemoveContainer" containerID="0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b"
Jul 15 13:18:16.475083 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.475058    2561 scope.go:117] "RemoveContainer" containerID="0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b"
Jul 15 13:18:16.475399 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:18:16.475375    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b\": container with ID starting with 0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b not found: ID does not exist" containerID="0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b"
Jul 15 13:18:16.475480 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.475410    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b"} err="failed to get container status \"0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b\": rpc error: code = NotFound desc = could not find container \"0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b\": container with ID starting with 0a5168b7545de06f3335988970252c7df58554e5b8803855b87728a46448ca5b not found: ID does not exist"
Jul 15 13:18:16.488100 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.488073    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:16.491781 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:16.491758    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2q6t5"]
Jul 15 13:18:17.585233 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:17.585198    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb3f4475-d3cd-45d4-92de-bfb10920e0c0" path="/var/lib/kubelet/pods/bb3f4475-d3cd-45d4-92de-bfb10920e0c0/volumes"
Jul 15 13:18:18.943783 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.943752    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"]
Jul 15 13:18:18.944140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.944088    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3f4475-d3cd-45d4-92de-bfb10920e0c0" containerName="limitador"
Jul 15 13:18:18.944140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.944101    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3f4475-d3cd-45d4-92de-bfb10920e0c0" containerName="limitador"
Jul 15 13:18:18.944216 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.944157    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3f4475-d3cd-45d4-92de-bfb10920e0c0" containerName="limitador"
Jul 15 13:18:18.948506 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.948490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:18.951699 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.951673    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:18:18.952667 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.952642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 13:18:18.952762 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.952647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 13:18:18.952762 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.952687    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-z9m8r\""
Jul 15 13:18:18.961190 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.961161    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"]
Jul 15 13:18:18.977431 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.977400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kr4w\" (UniqueName: \"kubernetes.io/projected/b1c0ab93-82b3-49cd-ba9f-86724cb79259-kube-api-access-7kr4w\") pod \"postgres-69fb4594cf-8zsvw\" (UID: \"b1c0ab93-82b3-49cd-ba9f-86724cb79259\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:18.977572 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:18.977499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1c0ab93-82b3-49cd-ba9f-86724cb79259-data\") pod \"postgres-69fb4594cf-8zsvw\" (UID: \"b1c0ab93-82b3-49cd-ba9f-86724cb79259\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:19.078788 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.078740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1c0ab93-82b3-49cd-ba9f-86724cb79259-data\") pod \"postgres-69fb4594cf-8zsvw\" (UID: \"b1c0ab93-82b3-49cd-ba9f-86724cb79259\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:19.078788 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.078801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kr4w\" (UniqueName: \"kubernetes.io/projected/b1c0ab93-82b3-49cd-ba9f-86724cb79259-kube-api-access-7kr4w\") pod \"postgres-69fb4594cf-8zsvw\" (UID: \"b1c0ab93-82b3-49cd-ba9f-86724cb79259\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:19.079139 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.079121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1c0ab93-82b3-49cd-ba9f-86724cb79259-data\") pod \"postgres-69fb4594cf-8zsvw\" (UID: \"b1c0ab93-82b3-49cd-ba9f-86724cb79259\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:19.088039 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.088008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kr4w\" (UniqueName: \"kubernetes.io/projected/b1c0ab93-82b3-49cd-ba9f-86724cb79259-kube-api-access-7kr4w\") pod \"postgres-69fb4594cf-8zsvw\" (UID: \"b1c0ab93-82b3-49cd-ba9f-86724cb79259\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:19.259373 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.259266    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:19.391430 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.391403    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"]
Jul 15 13:18:19.392998 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:18:19.392972    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c0ab93_82b3_49cd_ba9f_86724cb79259.slice/crio-75665fd70ffedad2e54d2badbdf1aff7531a14ffec67b7e7e8cb4d10c710475f WatchSource:0}: Error finding container 75665fd70ffedad2e54d2badbdf1aff7531a14ffec67b7e7e8cb4d10c710475f: Status 404 returned error can't find the container with id 75665fd70ffedad2e54d2badbdf1aff7531a14ffec67b7e7e8cb4d10c710475f
Jul 15 13:18:19.478506 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:19.478471    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw" event={"ID":"b1c0ab93-82b3-49cd-ba9f-86724cb79259","Type":"ContainerStarted","Data":"75665fd70ffedad2e54d2badbdf1aff7531a14ffec67b7e7e8cb4d10c710475f"}
Jul 15 13:18:24.514526 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:24.514475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw" event={"ID":"b1c0ab93-82b3-49cd-ba9f-86724cb79259","Type":"ContainerStarted","Data":"9ac8c254a8c92ee36fcc49ab8a3e0aa60835b12dfba22040604a9891fcc081d9"}
Jul 15 13:18:24.514920 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:24.514681    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:24.543091 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:24.543038    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw" podStartSLOduration=1.9915272050000001 podStartE2EDuration="6.543020542s" totalImagesPullingTime="4.551493337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:18:24.542507017 +0000 UTC m=+713.491524489" watchObservedRunningTime="2026-07-15 13:18:24.543020542 +0000 UTC m=+713.492038016"
Jul 15 13:18:30.551116 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:30.551087    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8zsvw"
Jul 15 13:18:37.381189 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.381153    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bfc489c56-8f5kc"]
Jul 15 13:18:37.401754 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.401722    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfc489c56-8f5kc"]
Jul 15 13:18:37.401887 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.401836    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.404646 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.404622    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 13:18:37.404646 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.404644    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-km4bx\""
Jul 15 13:18:37.404829 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.404793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 13:18:37.446952 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.446920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-webhook-cert\") pod \"maas-controller-7bfc489c56-8f5kc\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") " pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.447101 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.446978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkxd9\" (UniqueName: \"kubernetes.io/projected/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-kube-api-access-rkxd9\") pod \"maas-controller-7bfc489c56-8f5kc\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") " pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.547932 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.547836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-webhook-cert\") pod \"maas-controller-7bfc489c56-8f5kc\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") " pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.547932 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.547900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkxd9\" (UniqueName: \"kubernetes.io/projected/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-kube-api-access-rkxd9\") pod \"maas-controller-7bfc489c56-8f5kc\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") " pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.550428 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.550393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-webhook-cert\") pod \"maas-controller-7bfc489c56-8f5kc\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") " pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.555913 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.555889    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-7x4nf"]
Jul 15 13:18:37.559330 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.559305    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.560041 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.560020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkxd9\" (UniqueName: \"kubernetes.io/projected/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-kube-api-access-rkxd9\") pod \"maas-controller-7bfc489c56-8f5kc\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") " pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.574798 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.574773    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-7x4nf"]
Jul 15 13:18:37.649248 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.649217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4844a18f-77ec-411b-8a50-0c88224de0a0-webhook-cert\") pod \"maas-controller-9c84f7bcc-7x4nf\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") " pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.649248 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.649252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjrtk\" (UniqueName: \"kubernetes.io/projected/4844a18f-77ec-411b-8a50-0c88224de0a0-kube-api-access-cjrtk\") pod \"maas-controller-9c84f7bcc-7x4nf\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") " pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.712573 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.712541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:37.750531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.750496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4844a18f-77ec-411b-8a50-0c88224de0a0-webhook-cert\") pod \"maas-controller-9c84f7bcc-7x4nf\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") " pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.750665 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.750540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjrtk\" (UniqueName: \"kubernetes.io/projected/4844a18f-77ec-411b-8a50-0c88224de0a0-kube-api-access-cjrtk\") pod \"maas-controller-9c84f7bcc-7x4nf\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") " pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.753111 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.753072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4844a18f-77ec-411b-8a50-0c88224de0a0-webhook-cert\") pod \"maas-controller-9c84f7bcc-7x4nf\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") " pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.759393 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.759365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjrtk\" (UniqueName: \"kubernetes.io/projected/4844a18f-77ec-411b-8a50-0c88224de0a0-kube-api-access-cjrtk\") pod \"maas-controller-9c84f7bcc-7x4nf\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") " pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:37.849619 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.849526    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfc489c56-8f5kc"]
Jul 15 13:18:37.851973 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:18:37.851945    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb3aaa9_db3b_4a0d_8692_aa8086b1b87d.slice/crio-907e1dd5ae58aa36b113e2904a90fff0c6ca6b576e33f938a3dd73226cea9464 WatchSource:0}: Error finding container 907e1dd5ae58aa36b113e2904a90fff0c6ca6b576e33f938a3dd73226cea9464: Status 404 returned error can't find the container with id 907e1dd5ae58aa36b113e2904a90fff0c6ca6b576e33f938a3dd73226cea9464
Jul 15 13:18:37.876838 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:37.876807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:38.012102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:38.012077    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-7x4nf"]
Jul 15 13:18:38.014030 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:18:38.013992    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4844a18f_77ec_411b_8a50_0c88224de0a0.slice/crio-a8546b1c573148903b5dc1eae3ae3e7a15ce384af29157b5f8a0bcdc41a6ad64 WatchSource:0}: Error finding container a8546b1c573148903b5dc1eae3ae3e7a15ce384af29157b5f8a0bcdc41a6ad64: Status 404 returned error can't find the container with id a8546b1c573148903b5dc1eae3ae3e7a15ce384af29157b5f8a0bcdc41a6ad64
Jul 15 13:18:38.590064 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:38.590021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf" event={"ID":"4844a18f-77ec-411b-8a50-0c88224de0a0","Type":"ContainerStarted","Data":"a8546b1c573148903b5dc1eae3ae3e7a15ce384af29157b5f8a0bcdc41a6ad64"}
Jul 15 13:18:38.591660 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:38.591623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfc489c56-8f5kc" event={"ID":"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d","Type":"ContainerStarted","Data":"907e1dd5ae58aa36b113e2904a90fff0c6ca6b576e33f938a3dd73226cea9464"}
Jul 15 13:18:40.606671 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:40.606559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf" event={"ID":"4844a18f-77ec-411b-8a50-0c88224de0a0","Type":"ContainerStarted","Data":"8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13"}
Jul 15 13:18:40.607113 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:40.606677    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:40.608120 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:40.608096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfc489c56-8f5kc" event={"ID":"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d","Type":"ContainerStarted","Data":"a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333"}
Jul 15 13:18:40.608247 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:40.608232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:40.627054 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:40.626996    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf" podStartSLOduration=1.3749386430000001 podStartE2EDuration="3.626978687s" totalImagesPullingTime="2.252040044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:18:40.626493221 +0000 UTC m=+729.575510737" watchObservedRunningTime="2026-07-15 13:18:40.626978687 +0000 UTC m=+729.575996160"
Jul 15 13:18:40.652612 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:40.652553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bfc489c56-8f5kc" podStartSLOduration=1.239333171 podStartE2EDuration="3.65253601s" totalImagesPullingTime="2.413202839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:18:40.650242456 +0000 UTC m=+729.599259931" watchObservedRunningTime="2026-07-15 13:18:40.65253601 +0000 UTC m=+729.601553481"
Jul 15 13:18:51.614779 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:51.614745    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:51.615379 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:51.614819    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:18:51.685248 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:51.683003    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfc489c56-8f5kc"]
Jul 15 13:18:51.685248 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:51.683329    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bfc489c56-8f5kc" podUID="2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" containerName="manager" containerID="cri-o://a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333" gracePeriod=30
Jul 15 13:18:51.931873 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:51.931843    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:52.074746 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.074711    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkxd9\" (UniqueName: \"kubernetes.io/projected/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-kube-api-access-rkxd9\") pod \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") "
Jul 15 13:18:52.074908 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.074759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-webhook-cert\") pod \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\" (UID: \"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d\") "
Jul 15 13:18:52.076897 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.076860    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" (UID: "2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:18:52.077009 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.076896    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-kube-api-access-rkxd9" (OuterVolumeSpecName: "kube-api-access-rkxd9") pod "2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" (UID: "2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d"). InnerVolumeSpecName "kube-api-access-rkxd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:18:52.175526 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.175494    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-webhook-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:18:52.175526 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.175529    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkxd9\" (UniqueName: \"kubernetes.io/projected/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d-kube-api-access-rkxd9\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:18:52.668549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.668458    2561 generic.go:356] "Generic (PLEG): container finished" podID="2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" containerID="a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333" exitCode=0
Jul 15 13:18:52.668549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.668507    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfc489c56-8f5kc"
Jul 15 13:18:52.668549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.668532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfc489c56-8f5kc" event={"ID":"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d","Type":"ContainerDied","Data":"a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333"}
Jul 15 13:18:52.669025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.668583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfc489c56-8f5kc" event={"ID":"2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d","Type":"ContainerDied","Data":"907e1dd5ae58aa36b113e2904a90fff0c6ca6b576e33f938a3dd73226cea9464"}
Jul 15 13:18:52.669025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.668614    2561 scope.go:117] "RemoveContainer" containerID="a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333"
Jul 15 13:18:52.677748 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.677729    2561 scope.go:117] "RemoveContainer" containerID="a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333"
Jul 15 13:18:52.678015 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:18:52.677992    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333\": container with ID starting with a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333 not found: ID does not exist" containerID="a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333"
Jul 15 13:18:52.678076 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.678027    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333"} err="failed to get container status \"a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333\": rpc error: code = NotFound desc = could not find container \"a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333\": container with ID starting with a0dba49e202f66f8c17c4bfabac5d0a021e89b4e34771f3864cf130f67af4333 not found: ID does not exist"
Jul 15 13:18:52.690258 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.690233    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfc489c56-8f5kc"]
Jul 15 13:18:52.694290 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:52.694251    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bfc489c56-8f5kc"]
Jul 15 13:18:53.585141 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:18:53.585108    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" path="/var/lib/kubelet/pods/2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d/volumes"
Jul 15 13:19:13.929724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.929676    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"]
Jul 15 13:19:13.930091 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.929998    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" containerName="manager"
Jul 15 13:19:13.930091 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.930009    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" containerName="manager"
Jul 15 13:19:13.930091 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.930077    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb3aaa9-db3b-4a0d-8692-aa8086b1b87d" containerName="manager"
Jul 15 13:19:13.934946 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.934925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:13.938857 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.938806    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 13:19:13.940002 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.939981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dfh9q\""
Jul 15 13:19:13.950370 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.950339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"]
Jul 15 13:19:13.963403 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.963374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ad30b3-0703-4b66-ac79-7916bc0d248c-openshift-service-ca\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:13.963554 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.963417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ad30b3-0703-4b66-ac79-7916bc0d248c-maas-api-tls\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:13.963554 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:13.963448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qqfj\" (UniqueName: \"kubernetes.io/projected/97ad30b3-0703-4b66-ac79-7916bc0d248c-kube-api-access-8qqfj\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.064863 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.064819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ad30b3-0703-4b66-ac79-7916bc0d248c-openshift-service-ca\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.065060 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.064879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ad30b3-0703-4b66-ac79-7916bc0d248c-maas-api-tls\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.065060 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.064915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qqfj\" (UniqueName: \"kubernetes.io/projected/97ad30b3-0703-4b66-ac79-7916bc0d248c-kube-api-access-8qqfj\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.065577 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.065551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ad30b3-0703-4b66-ac79-7916bc0d248c-openshift-service-ca\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.067322 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.067300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ad30b3-0703-4b66-ac79-7916bc0d248c-maas-api-tls\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.075780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.075750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qqfj\" (UniqueName: \"kubernetes.io/projected/97ad30b3-0703-4b66-ac79-7916bc0d248c-kube-api-access-8qqfj\") pod \"maas-api-6b4f6d47b-pmpx2\" (UID: \"97ad30b3-0703-4b66-ac79-7916bc0d248c\") " pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.245069 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.244979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:14.384641 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.384611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"]
Jul 15 13:19:14.386119 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:19:14.386095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ad30b3_0703_4b66_ac79_7916bc0d248c.slice/crio-6913dc4a03541584d8195687db84367a414baf77870e6aadcefaa20aef1dcbbe WatchSource:0}: Error finding container 6913dc4a03541584d8195687db84367a414baf77870e6aadcefaa20aef1dcbbe: Status 404 returned error can't find the container with id 6913dc4a03541584d8195687db84367a414baf77870e6aadcefaa20aef1dcbbe
Jul 15 13:19:14.570850 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.570773    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"]
Jul 15 13:19:14.574122 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.574081    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.576769 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.576747    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k5mg5\""
Jul 15 13:19:14.576897 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.576818    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 13:19:14.582205 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.582180    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"]
Jul 15 13:19:14.669924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.669892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5wp\" (UniqueName: \"kubernetes.io/projected/50b3828a-7acf-4200-9fba-01fd34635d5d-kube-api-access-fm5wp\") pod \"payload-processing-f9b8d9b9b-pgrlr\" (UID: \"50b3828a-7acf-4200-9fba-01fd34635d5d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.670095 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.669934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b3828a-7acf-4200-9fba-01fd34635d5d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pgrlr\" (UID: \"50b3828a-7acf-4200-9fba-01fd34635d5d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.770950 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.770912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5wp\" (UniqueName: \"kubernetes.io/projected/50b3828a-7acf-4200-9fba-01fd34635d5d-kube-api-access-fm5wp\") pod \"payload-processing-f9b8d9b9b-pgrlr\" (UID: \"50b3828a-7acf-4200-9fba-01fd34635d5d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.770950 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.770953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b3828a-7acf-4200-9fba-01fd34635d5d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pgrlr\" (UID: \"50b3828a-7acf-4200-9fba-01fd34635d5d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.771717 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.771689    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b3828a-7acf-4200-9fba-01fd34635d5d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pgrlr\" (UID: \"50b3828a-7acf-4200-9fba-01fd34635d5d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.779333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.779300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5wp\" (UniqueName: \"kubernetes.io/projected/50b3828a-7acf-4200-9fba-01fd34635d5d-kube-api-access-fm5wp\") pod \"payload-processing-f9b8d9b9b-pgrlr\" (UID: \"50b3828a-7acf-4200-9fba-01fd34635d5d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:14.791665 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.791632    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2" event={"ID":"97ad30b3-0703-4b66-ac79-7916bc0d248c","Type":"ContainerStarted","Data":"6913dc4a03541584d8195687db84367a414baf77870e6aadcefaa20aef1dcbbe"}
Jul 15 13:19:14.887570 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:14.887427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:15.020992 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:15.020962    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"]
Jul 15 13:19:15.023397 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:19:15.023368    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b3828a_7acf_4200_9fba_01fd34635d5d.slice/crio-ee4b3808277343ae6508e5200d61b262f4fac0a1f6ace952b2270fbbf1dbcc1c WatchSource:0}: Error finding container ee4b3808277343ae6508e5200d61b262f4fac0a1f6ace952b2270fbbf1dbcc1c: Status 404 returned error can't find the container with id ee4b3808277343ae6508e5200d61b262f4fac0a1f6ace952b2270fbbf1dbcc1c
Jul 15 13:19:15.798525 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:15.798489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr" event={"ID":"50b3828a-7acf-4200-9fba-01fd34635d5d","Type":"ContainerStarted","Data":"ee4b3808277343ae6508e5200d61b262f4fac0a1f6ace952b2270fbbf1dbcc1c"}
Jul 15 13:19:17.811097 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:17.811050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr" event={"ID":"50b3828a-7acf-4200-9fba-01fd34635d5d","Type":"ContainerStarted","Data":"96c2d42b24f9cb8be8fadb4554f9730a808adf3d3878d51524c1a10a1b7d79c0"}
Jul 15 13:19:17.811587 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:17.811130    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:17.812584 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:17.812556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2" event={"ID":"97ad30b3-0703-4b66-ac79-7916bc0d248c","Type":"ContainerStarted","Data":"445d27b48ad8c840dac8c186f01cb6f992e1e33020243736ca7f8a4ceff2ae87"}
Jul 15 13:19:17.812715 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:17.812689    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:17.830038 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:17.829990    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr" podStartSLOduration=1.6118482520000001 podStartE2EDuration="3.829975904s" totalImagesPullingTime="2.218127652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:19:17.828350665 +0000 UTC m=+766.777368142" watchObservedRunningTime="2026-07-15 13:19:17.829975904 +0000 UTC m=+766.778993374"
Jul 15 13:19:17.846221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:17.846163    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2" podStartSLOduration=1.988243628 podStartE2EDuration="4.846133779s" totalImagesPullingTime="2.857890151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:19:17.844024352 +0000 UTC m=+766.793041825" watchObservedRunningTime="2026-07-15 13:19:17.846133779 +0000 UTC m=+766.795151251"
Jul 15 13:19:23.823324 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:23.823292    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b4f6d47b-pmpx2"
Jul 15 13:19:28.820855 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:28.820820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pgrlr"
Jul 15 13:19:38.608723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.608692    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"]
Jul 15 13:19:38.612835 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.612817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.617348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.617315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6wk5z\""
Jul 15 13:19:38.617348 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.617319    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 13:19:38.617519 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.617350    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 13:19:38.617703 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.617689    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 13:19:38.624694 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.624668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"]
Jul 15 13:19:38.686100 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.686065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.686265 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.686107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.686265 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.686146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd867b3-7a93-43bc-8b97-8bf0a3aea381-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.686265 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.686207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfmb8\" (UniqueName: \"kubernetes.io/projected/edd867b3-7a93-43bc-8b97-8bf0a3aea381-kube-api-access-dfmb8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.686414 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.686344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.686414 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.686368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.786794 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.786766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.786794 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.786798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787012 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.786839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787012 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.786879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787012 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.786912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd867b3-7a93-43bc-8b97-8bf0a3aea381-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787012 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.786941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfmb8\" (UniqueName: \"kubernetes.io/projected/edd867b3-7a93-43bc-8b97-8bf0a3aea381-kube-api-access-dfmb8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.787218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787354 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.787333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.787454 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.787435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.789135 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.789110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd867b3-7a93-43bc-8b97-8bf0a3aea381-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.789393 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.789375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd867b3-7a93-43bc-8b97-8bf0a3aea381-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.797000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.796968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfmb8\" (UniqueName: \"kubernetes.io/projected/edd867b3-7a93-43bc-8b97-8bf0a3aea381-kube-api-access-dfmb8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4b8mh\" (UID: \"edd867b3-7a93-43bc-8b97-8bf0a3aea381\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:38.924148 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:38.924062    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:39.066010 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:39.065984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"]
Jul 15 13:19:39.068332 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:19:39.068306    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd867b3_7a93_43bc_8b97_8bf0a3aea381.slice/crio-a7d8ca95946f677436b4ec9efa151dfb790f01df1ecef9d7e68e303a8ae8ac3f WatchSource:0}: Error finding container a7d8ca95946f677436b4ec9efa151dfb790f01df1ecef9d7e68e303a8ae8ac3f: Status 404 returned error can't find the container with id a7d8ca95946f677436b4ec9efa151dfb790f01df1ecef9d7e68e303a8ae8ac3f
Jul 15 13:19:39.926456 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:39.926412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh" event={"ID":"edd867b3-7a93-43bc-8b97-8bf0a3aea381","Type":"ContainerStarted","Data":"a7d8ca95946f677436b4ec9efa151dfb790f01df1ecef9d7e68e303a8ae8ac3f"}
Jul 15 13:19:40.932706 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:40.932670    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh" event={"ID":"edd867b3-7a93-43bc-8b97-8bf0a3aea381","Type":"ContainerStarted","Data":"ef703e3832ac1bd757a704564f1eb4598a66c0e20f6894e65fda2fe162ca612a"}
Jul 15 13:19:40.958506 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:40.958456    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh" podStartSLOduration=1.785327454 podStartE2EDuration="2.958441515s" totalImagesPullingTime="1.173114061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:19:40.957730172 +0000 UTC m=+789.906747644" watchObservedRunningTime="2026-07-15 13:19:40.958441515 +0000 UTC m=+789.907459033"
Jul 15 13:19:48.924751 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:48.924712    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:48.925148 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:48.924859    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:48.937422 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:48.937393    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:19:48.984416 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:19:48.984390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4b8mh"
Jul 15 13:20:04.215453 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.215418    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"]
Jul 15 13:20:04.218952 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.218928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.222406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.222383    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 13:20:04.233524 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.233497    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"]
Jul 15 13:20:04.313182 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.313140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qtn\" (UniqueName: \"kubernetes.io/projected/c26f63e1-51fa-4bfc-a342-791c80866db8-kube-api-access-j7qtn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.313493 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.313245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.313493 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.313296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.313493 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.313330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.313685 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.313538    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26f63e1-51fa-4bfc-a342-791c80866db8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.313685 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.313626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.414888 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.414855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.414915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qtn\" (UniqueName: \"kubernetes.io/projected/c26f63e1-51fa-4bfc-a342-791c80866db8-kube-api-access-j7qtn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.414937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.414951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.414974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.415001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26f63e1-51fa-4bfc-a342-791c80866db8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415470 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.415443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415590 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.415574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.415652 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.415594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.417286 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.417250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26f63e1-51fa-4bfc-a342-791c80866db8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.417862 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.417841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26f63e1-51fa-4bfc-a342-791c80866db8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.430684 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.430659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qtn\" (UniqueName: \"kubernetes.io/projected/c26f63e1-51fa-4bfc-a342-791c80866db8-kube-api-access-j7qtn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r\" (UID: \"c26f63e1-51fa-4bfc-a342-791c80866db8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.529160 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.529063    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:04.683908 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:04.683880    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"]
Jul 15 13:20:04.686141 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:20:04.686103    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26f63e1_51fa_4bfc_a342_791c80866db8.slice/crio-c7674392abb337bce9b5f35babfa19983ca9c991f5ec9a2c6a7ae9910e2d18b4 WatchSource:0}: Error finding container c7674392abb337bce9b5f35babfa19983ca9c991f5ec9a2c6a7ae9910e2d18b4: Status 404 returned error can't find the container with id c7674392abb337bce9b5f35babfa19983ca9c991f5ec9a2c6a7ae9910e2d18b4
Jul 15 13:20:05.056047 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:05.056003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r" event={"ID":"c26f63e1-51fa-4bfc-a342-791c80866db8","Type":"ContainerStarted","Data":"68c5b09ead3342051ba260de720542874d0d25ddfa367ef664d45b276344ad5e"}
Jul 15 13:20:05.056213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:05.056076    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r" event={"ID":"c26f63e1-51fa-4bfc-a342-791c80866db8","Type":"ContainerStarted","Data":"c7674392abb337bce9b5f35babfa19983ca9c991f5ec9a2c6a7ae9910e2d18b4"}
Jul 15 13:20:05.090819 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:05.090764    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r" podStartSLOduration=0.839374241 podStartE2EDuration="1.090745738s" totalImagesPullingTime="251.371497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:20:05.089174381 +0000 UTC m=+814.038191892" watchObservedRunningTime="2026-07-15 13:20:05.090745738 +0000 UTC m=+814.039763210"
Jul 15 13:20:14.529656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:14.529609    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:14.530229 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:14.529696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:14.541988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:14.541936    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:20:15.122932 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:20:15.122899    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r"
Jul 15 13:21:31.484139 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:21:31.484110    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:21:31.485433 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:21:31.485411    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:21:31.486352 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:21:31.486326    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:21:31.487582 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:21:31.487563    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:21:31.494238 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:21:31.494220    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:21:31.495422 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:21:31.495404    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:22:33.449399 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.449364    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-7x4nf"]
Jul 15 13:22:33.449995 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.449568    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf" podUID="4844a18f-77ec-411b-8a50-0c88224de0a0" containerName="manager" containerID="cri-o://8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13" gracePeriod=30
Jul 15 13:22:33.702355 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.702292    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:22:33.821352 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.821309    2561 generic.go:356] "Generic (PLEG): container finished" podID="4844a18f-77ec-411b-8a50-0c88224de0a0" containerID="8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13" exitCode=0
Jul 15 13:22:33.821530 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.821363    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf"
Jul 15 13:22:33.821530 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.821391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf" event={"ID":"4844a18f-77ec-411b-8a50-0c88224de0a0","Type":"ContainerDied","Data":"8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13"}
Jul 15 13:22:33.821530 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.821452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c84f7bcc-7x4nf" event={"ID":"4844a18f-77ec-411b-8a50-0c88224de0a0","Type":"ContainerDied","Data":"a8546b1c573148903b5dc1eae3ae3e7a15ce384af29157b5f8a0bcdc41a6ad64"}
Jul 15 13:22:33.821530 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.821475    2561 scope.go:117] "RemoveContainer" containerID="8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13"
Jul 15 13:22:33.830254 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.830231    2561 scope.go:117] "RemoveContainer" containerID="8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13"
Jul 15 13:22:33.830593 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:22:33.830556    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13\": container with ID starting with 8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13 not found: ID does not exist" containerID="8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13"
Jul 15 13:22:33.830685 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.830602    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13"} err="failed to get container status \"8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13\": rpc error: code = NotFound desc = could not find container \"8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13\": container with ID starting with 8ac823da9de1b367657deb47046200d1775ddf6d96572ab5b385f7549e006f13 not found: ID does not exist"
Jul 15 13:22:33.864095 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.864063    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjrtk\" (UniqueName: \"kubernetes.io/projected/4844a18f-77ec-411b-8a50-0c88224de0a0-kube-api-access-cjrtk\") pod \"4844a18f-77ec-411b-8a50-0c88224de0a0\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") "
Jul 15 13:22:33.864229 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.864100    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4844a18f-77ec-411b-8a50-0c88224de0a0-webhook-cert\") pod \"4844a18f-77ec-411b-8a50-0c88224de0a0\" (UID: \"4844a18f-77ec-411b-8a50-0c88224de0a0\") "
Jul 15 13:22:33.866146 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.866106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4844a18f-77ec-411b-8a50-0c88224de0a0-kube-api-access-cjrtk" (OuterVolumeSpecName: "kube-api-access-cjrtk") pod "4844a18f-77ec-411b-8a50-0c88224de0a0" (UID: "4844a18f-77ec-411b-8a50-0c88224de0a0"). InnerVolumeSpecName "kube-api-access-cjrtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:22:33.866251 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.866185    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4844a18f-77ec-411b-8a50-0c88224de0a0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4844a18f-77ec-411b-8a50-0c88224de0a0" (UID: "4844a18f-77ec-411b-8a50-0c88224de0a0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:22:33.964983 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.964904    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjrtk\" (UniqueName: \"kubernetes.io/projected/4844a18f-77ec-411b-8a50-0c88224de0a0-kube-api-access-cjrtk\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:22:33.964983 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:33.964931    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4844a18f-77ec-411b-8a50-0c88224de0a0-webhook-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:22:34.146390 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.146356    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-7x4nf"]
Jul 15 13:22:34.151519 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.151494    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-7x4nf"]
Jul 15 13:22:34.939884 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.939843    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-4tz9n"]
Jul 15 13:22:34.940361 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.940242    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4844a18f-77ec-411b-8a50-0c88224de0a0" containerName="manager"
Jul 15 13:22:34.940361 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.940256    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4844a18f-77ec-411b-8a50-0c88224de0a0" containerName="manager"
Jul 15 13:22:34.940361 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.940347    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4844a18f-77ec-411b-8a50-0c88224de0a0" containerName="manager"
Jul 15 13:22:34.944649 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.944628    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:34.948314 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.948293    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-km4bx\""
Jul 15 13:22:34.948314 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.948303    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 13:22:34.948483 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.948319    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 13:22:34.954973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:34.954949    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-4tz9n"]
Jul 15 13:22:35.075244 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.075200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0874dca-7a30-49b3-a27a-c16a86942c37-webhook-cert\") pod \"maas-controller-9c84f7bcc-4tz9n\" (UID: \"d0874dca-7a30-49b3-a27a-c16a86942c37\") " pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.075450 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.075299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x284g\" (UniqueName: \"kubernetes.io/projected/d0874dca-7a30-49b3-a27a-c16a86942c37-kube-api-access-x284g\") pod \"maas-controller-9c84f7bcc-4tz9n\" (UID: \"d0874dca-7a30-49b3-a27a-c16a86942c37\") " pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.176169 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.176131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x284g\" (UniqueName: \"kubernetes.io/projected/d0874dca-7a30-49b3-a27a-c16a86942c37-kube-api-access-x284g\") pod \"maas-controller-9c84f7bcc-4tz9n\" (UID: \"d0874dca-7a30-49b3-a27a-c16a86942c37\") " pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.176375 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.176205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0874dca-7a30-49b3-a27a-c16a86942c37-webhook-cert\") pod \"maas-controller-9c84f7bcc-4tz9n\" (UID: \"d0874dca-7a30-49b3-a27a-c16a86942c37\") " pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.178632 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.178607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0874dca-7a30-49b3-a27a-c16a86942c37-webhook-cert\") pod \"maas-controller-9c84f7bcc-4tz9n\" (UID: \"d0874dca-7a30-49b3-a27a-c16a86942c37\") " pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.185372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.185353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x284g\" (UniqueName: \"kubernetes.io/projected/d0874dca-7a30-49b3-a27a-c16a86942c37-kube-api-access-x284g\") pod \"maas-controller-9c84f7bcc-4tz9n\" (UID: \"d0874dca-7a30-49b3-a27a-c16a86942c37\") " pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.256316 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.256197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:35.396582 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.396557    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c84f7bcc-4tz9n"]
Jul 15 13:22:35.398818 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:22:35.398791    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0874dca_7a30_49b3_a27a_c16a86942c37.slice/crio-51dc6ab4f8c097e154c9a2edca20d9765dc55f53de9afdbbcfb645bce2f76126 WatchSource:0}: Error finding container 51dc6ab4f8c097e154c9a2edca20d9765dc55f53de9afdbbcfb645bce2f76126: Status 404 returned error can't find the container with id 51dc6ab4f8c097e154c9a2edca20d9765dc55f53de9afdbbcfb645bce2f76126
Jul 15 13:22:35.400234 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.400213    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:22:35.585465 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.585389    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4844a18f-77ec-411b-8a50-0c88224de0a0" path="/var/lib/kubelet/pods/4844a18f-77ec-411b-8a50-0c88224de0a0/volumes"
Jul 15 13:22:35.841504 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:35.841470    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n" event={"ID":"d0874dca-7a30-49b3-a27a-c16a86942c37","Type":"ContainerStarted","Data":"51dc6ab4f8c097e154c9a2edca20d9765dc55f53de9afdbbcfb645bce2f76126"}
Jul 15 13:22:36.848044 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:36.848006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n" event={"ID":"d0874dca-7a30-49b3-a27a-c16a86942c37","Type":"ContainerStarted","Data":"c5a8d4b9b53468d49d36eec2eefe537d612816fa9eaf9ee9ffeb65d3a91ceb19"}
Jul 15 13:22:36.848464 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:36.848128    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:22:36.869227 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:36.869177    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n" podStartSLOduration=2.428593184 podStartE2EDuration="2.869158594s" totalImagesPullingTime="440.56541ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:22:36.86773695 +0000 UTC m=+965.816754421" watchObservedRunningTime="2026-07-15 13:22:36.869158594 +0000 UTC m=+965.818176065"
Jul 15 13:22:47.856098 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:22:47.856062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c84f7bcc-4tz9n"
Jul 15 13:26:31.518873 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:26:31.518839    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:26:31.521354 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:26:31.521330    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:26:31.521624 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:26:31.521604    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:26:31.523861 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:26:31.523841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:26:31.529205 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:26:31.529186    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:26:31.532140 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:26:31.532106    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:31:31.556323 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:31:31.556267    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:31:31.558608 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:31:31.558580    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:31:31.559993 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:31:31.559970    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:31:31.562297 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:31:31.562265    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:31:31.566656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:31:31.566637    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:31:31.570476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:31:31.570458    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:34:21.358183 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.358150    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"]
Jul 15 13:34:21.361736 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.361712    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.373420 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.373399    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fb3eae66-serving-cert\""
Jul 15 13:34:21.393202 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.393178    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"]
Jul 15 13:34:21.425446 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.425413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.425592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.425454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg48\" (UniqueName: \"kubernetes.io/projected/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-kube-api-access-6pg48\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.425592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.425492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-openshift-service-ca\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.526475 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.526439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.526475 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.526482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg48\" (UniqueName: \"kubernetes.io/projected/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-kube-api-access-6pg48\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.526744 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:34:21.526585    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-serving-cert: secret "maas-api-e2e-ait-fb3eae66-serving-cert" not found
Jul 15 13:34:21.526744 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:34:21.526648    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls podName:8458ae90-a5c2-46de-b4e8-e7b43e77dbd5 nodeName:}" failed. No retries permitted until 2026-07-15 13:34:22.026627482 +0000 UTC m=+1670.975644956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls") pod "maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" (UID: "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5") : secret "maas-api-e2e-ait-fb3eae66-serving-cert" not found
Jul 15 13:34:21.526744 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.526666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-openshift-service-ca\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.527324 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.527299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-openshift-service-ca\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:21.538517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:21.538487    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg48\" (UniqueName: \"kubernetes.io/projected/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-kube-api-access-6pg48\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:22.032025 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:22.031987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:22.034540 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:22.034519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls\") pod \"maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:22.272057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:22.272022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:22.414620 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:22.414592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"]
Jul 15 13:34:22.417173 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:34:22.417147    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8458ae90_a5c2_46de_b4e8_e7b43e77dbd5.slice/crio-12e6bea937f4a128cf55691764257b155f515529bffdaa1e5162b0bea387a023 WatchSource:0}: Error finding container 12e6bea937f4a128cf55691764257b155f515529bffdaa1e5162b0bea387a023: Status 404 returned error can't find the container with id 12e6bea937f4a128cf55691764257b155f515529bffdaa1e5162b0bea387a023
Jul 15 13:34:22.418656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:22.418635    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:34:22.482758 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:22.482722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" event={"ID":"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5","Type":"ContainerStarted","Data":"12e6bea937f4a128cf55691764257b155f515529bffdaa1e5162b0bea387a023"}
Jul 15 13:34:23.489854 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:23.489811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" event={"ID":"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5","Type":"ContainerStarted","Data":"64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571"}
Jul 15 13:34:23.490345 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:23.490027    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:29.501255 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:29.501219    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:34:29.522062 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:34:29.522007    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" podStartSLOduration=7.819336148 podStartE2EDuration="8.521992501s" totalImagesPullingTime="702.656353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:34:23.524742388 +0000 UTC m=+1672.473759874" watchObservedRunningTime="2026-07-15 13:34:29.521992501 +0000 UTC m=+1678.471009972"
Jul 15 13:35:36.596563 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.596511    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"]
Jul 15 13:35:36.597132 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.596744    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" podUID="8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" containerName="maas-api" containerID="cri-o://64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571" gracePeriod=30
Jul 15 13:35:36.849535 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.849469    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:35:36.870368 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.870333    2561 generic.go:356] "Generic (PLEG): container finished" podID="8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" containerID="64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571" exitCode=0
Jul 15 13:35:36.870538 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.870375    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"
Jul 15 13:35:36.870538 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.870411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" event={"ID":"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5","Type":"ContainerDied","Data":"64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571"}
Jul 15 13:35:36.870538 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.870465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2" event={"ID":"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5","Type":"ContainerDied","Data":"12e6bea937f4a128cf55691764257b155f515529bffdaa1e5162b0bea387a023"}
Jul 15 13:35:36.870538 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.870479    2561 scope.go:117] "RemoveContainer" containerID="64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571"
Jul 15 13:35:36.880748 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.880728    2561 scope.go:117] "RemoveContainer" containerID="64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571"
Jul 15 13:35:36.881078 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:35:36.881053    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571\": container with ID starting with 64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571 not found: ID does not exist" containerID="64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571"
Jul 15 13:35:36.881157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.881092    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571"} err="failed to get container status \"64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571\": rpc error: code = NotFound desc = could not find container \"64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571\": container with ID starting with 64a1aae232ed84a4cb0e1e5681381f0263399cba93c264690d8d5f1809258571 not found: ID does not exist"
Jul 15 13:35:36.977602 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.977558    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls\") pod \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") "
Jul 15 13:35:36.977782 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.977636    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pg48\" (UniqueName: \"kubernetes.io/projected/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-kube-api-access-6pg48\") pod \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") "
Jul 15 13:35:36.977782 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.977677    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-openshift-service-ca\") pod \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\" (UID: \"8458ae90-a5c2-46de-b4e8-e7b43e77dbd5\") "
Jul 15 13:35:36.978063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.978042    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" (UID: "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:35:36.979973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.979947    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" (UID: "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:35:36.980049 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:36.979957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-kube-api-access-6pg48" (OuterVolumeSpecName: "kube-api-access-6pg48") pod "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" (UID: "8458ae90-a5c2-46de-b4e8-e7b43e77dbd5"). InnerVolumeSpecName "kube-api-access-6pg48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:35:37.078973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:37.078933    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pg48\" (UniqueName: \"kubernetes.io/projected/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-kube-api-access-6pg48\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:35:37.078973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:37.078966    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:35:37.078973 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:37.078977    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:35:37.203125 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:37.203090    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"]
Jul 15 13:35:37.214750 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:37.214722    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3eae66-b5b6c6677-dd9v2"]
Jul 15 13:35:37.585607 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:37.585529    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" path="/var/lib/kubelet/pods/8458ae90-a5c2-46de-b4e8-e7b43e77dbd5/volumes"
Jul 15 13:35:53.391840 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.391798    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"]
Jul 15 13:35:53.392687 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.392662    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" containerName="maas-api"
Jul 15 13:35:53.392860 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.392848    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" containerName="maas-api"
Jul 15 13:35:53.393152 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.393139    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8458ae90-a5c2-46de-b4e8-e7b43e77dbd5" containerName="maas-api"
Jul 15 13:35:53.398789 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.398760    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.401251 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.401224    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-faa562cb-serving-cert\""
Jul 15 13:35:53.403464 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.403435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"]
Jul 15 13:35:53.521155 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.521113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a4c524-c894-474d-83e1-39f78f2d6b6a-openshift-service-ca\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.521155 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.521157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.521413 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.521184    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6z4q\" (UniqueName: \"kubernetes.io/projected/b7a4c524-c894-474d-83e1-39f78f2d6b6a-kube-api-access-t6z4q\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.622570 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.622537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a4c524-c894-474d-83e1-39f78f2d6b6a-openshift-service-ca\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.622570 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.622571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.622784 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.622592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6z4q\" (UniqueName: \"kubernetes.io/projected/b7a4c524-c894-474d-83e1-39f78f2d6b6a-kube-api-access-t6z4q\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.622784 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:35:53.622695    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-serving-cert: secret "maas-api-e2e-migrate-faa562cb-serving-cert" not found
Jul 15 13:35:53.622784 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:35:53.622760    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls podName:b7a4c524-c894-474d-83e1-39f78f2d6b6a nodeName:}" failed. No retries permitted until 2026-07-15 13:35:54.122742908 +0000 UTC m=+1763.071760374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls") pod "maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" (UID: "b7a4c524-c894-474d-83e1-39f78f2d6b6a") : secret "maas-api-e2e-migrate-faa562cb-serving-cert" not found
Jul 15 13:35:53.623165 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.623145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a4c524-c894-474d-83e1-39f78f2d6b6a-openshift-service-ca\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:53.631202 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:53.631168    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6z4q\" (UniqueName: \"kubernetes.io/projected/b7a4c524-c894-474d-83e1-39f78f2d6b6a-kube-api-access-t6z4q\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:54.127859 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:54.127816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:54.130199 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:54.130165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls\") pod \"maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:54.312476 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:54.312429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:54.461884 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:54.461857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"]
Jul 15 13:35:54.463330 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:35:54.463300    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a4c524_c894_474d_83e1_39f78f2d6b6a.slice/crio-441e2a72dbe51d0b0b41166608dcfa0643e44af2fbe34d13e92f6c5f97e68cc6 WatchSource:0}: Error finding container 441e2a72dbe51d0b0b41166608dcfa0643e44af2fbe34d13e92f6c5f97e68cc6: Status 404 returned error can't find the container with id 441e2a72dbe51d0b0b41166608dcfa0643e44af2fbe34d13e92f6c5f97e68cc6
Jul 15 13:35:54.968772 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:54.968735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" event={"ID":"b7a4c524-c894-474d-83e1-39f78f2d6b6a","Type":"ContainerStarted","Data":"441e2a72dbe51d0b0b41166608dcfa0643e44af2fbe34d13e92f6c5f97e68cc6"}
Jul 15 13:35:55.976250 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:55.976207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" event={"ID":"b7a4c524-c894-474d-83e1-39f78f2d6b6a","Type":"ContainerStarted","Data":"6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077"}
Jul 15 13:35:55.976653 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:55.976314    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:35:55.997211 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:35:55.997152    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" podStartSLOduration=2.461604438 podStartE2EDuration="2.997137811s" totalImagesPullingTime="535.533373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:35:55.994839092 +0000 UTC m=+1764.943856568" watchObservedRunningTime="2026-07-15 13:35:55.997137811 +0000 UTC m=+1764.946155282"
Jul 15 13:36:01.986890 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:01.986863    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:36:31.592557 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:31.592526    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:36:31.602466 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:31.602440    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:36:31.604755 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:31.604731    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:36:31.606934 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:31.606915    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:36:31.610249 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:31.610232    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:36:31.614240 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:31.614222    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:36:58.457513 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.457465    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"]
Jul 15 13:36:58.458185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.458109    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" podUID="b7a4c524-c894-474d-83e1-39f78f2d6b6a" containerName="maas-api" containerID="cri-o://6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077" gracePeriod=30
Jul 15 13:36:58.708664 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.708601    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:36:58.816236 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.816197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls\") pod \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") "
Jul 15 13:36:58.816465 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.816295    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6z4q\" (UniqueName: \"kubernetes.io/projected/b7a4c524-c894-474d-83e1-39f78f2d6b6a-kube-api-access-t6z4q\") pod \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") "
Jul 15 13:36:58.816465 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.816335    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a4c524-c894-474d-83e1-39f78f2d6b6a-openshift-service-ca\") pod \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\" (UID: \"b7a4c524-c894-474d-83e1-39f78f2d6b6a\") "
Jul 15 13:36:58.816749 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.816713    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7a4c524-c894-474d-83e1-39f78f2d6b6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7a4c524-c894-474d-83e1-39f78f2d6b6a" (UID: "b7a4c524-c894-474d-83e1-39f78f2d6b6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:36:58.818427 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.818399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a4c524-c894-474d-83e1-39f78f2d6b6a-kube-api-access-t6z4q" (OuterVolumeSpecName: "kube-api-access-t6z4q") pod "b7a4c524-c894-474d-83e1-39f78f2d6b6a" (UID: "b7a4c524-c894-474d-83e1-39f78f2d6b6a"). InnerVolumeSpecName "kube-api-access-t6z4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:36:58.818522 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.818423    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7a4c524-c894-474d-83e1-39f78f2d6b6a" (UID: "b7a4c524-c894-474d-83e1-39f78f2d6b6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:36:58.917809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.917767    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a4c524-c894-474d-83e1-39f78f2d6b6a-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:36:58.917809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.917800    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6z4q\" (UniqueName: \"kubernetes.io/projected/b7a4c524-c894-474d-83e1-39f78f2d6b6a-kube-api-access-t6z4q\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:36:58.917809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:58.917812    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a4c524-c894-474d-83e1-39f78f2d6b6a-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:36:59.309728 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.309693    2561 generic.go:356] "Generic (PLEG): container finished" podID="b7a4c524-c894-474d-83e1-39f78f2d6b6a" containerID="6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077" exitCode=0
Jul 15 13:36:59.309936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.309732    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"
Jul 15 13:36:59.309936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.309783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" event={"ID":"b7a4c524-c894-474d-83e1-39f78f2d6b6a","Type":"ContainerDied","Data":"6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077"}
Jul 15 13:36:59.309936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.309843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7" event={"ID":"b7a4c524-c894-474d-83e1-39f78f2d6b6a","Type":"ContainerDied","Data":"441e2a72dbe51d0b0b41166608dcfa0643e44af2fbe34d13e92f6c5f97e68cc6"}
Jul 15 13:36:59.309936 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.309873    2561 scope.go:117] "RemoveContainer" containerID="6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077"
Jul 15 13:36:59.319969 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.319949    2561 scope.go:117] "RemoveContainer" containerID="6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077"
Jul 15 13:36:59.320268 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:36:59.320245    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077\": container with ID starting with 6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077 not found: ID does not exist" containerID="6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077"
Jul 15 13:36:59.320365 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.320295    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077"} err="failed to get container status \"6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077\": rpc error: code = NotFound desc = could not find container \"6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077\": container with ID starting with 6219df46414bf5b72f15cc9bd314a027fc924d817ea2409fa5e72dd4e7019077 not found: ID does not exist"
Jul 15 13:36:59.334852 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.334821    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"]
Jul 15 13:36:59.336870 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.336848    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-faa562cb-6db95875d4-6tgm7"]
Jul 15 13:36:59.585321 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:36:59.585222    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a4c524-c894-474d-83e1-39f78f2d6b6a" path="/var/lib/kubelet/pods/b7a4c524-c894-474d-83e1-39f78f2d6b6a/volumes"
Jul 15 13:37:05.755094 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.755060    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"]
Jul 15 13:37:05.755548 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.755421    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a4c524-c894-474d-83e1-39f78f2d6b6a" containerName="maas-api"
Jul 15 13:37:05.755548 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.755433    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a4c524-c894-474d-83e1-39f78f2d6b6a" containerName="maas-api"
Jul 15 13:37:05.755548 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.755501    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a4c524-c894-474d-83e1-39f78f2d6b6a" containerName="maas-api"
Jul 15 13:37:05.758549 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.758532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.762225 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.762201    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b9daa40c-serving-cert\""
Jul 15 13:37:05.773482 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.773448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"]
Jul 15 13:37:05.879468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.879434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/531a6778-4b9f-435b-bb0b-e80ef877f32d-openshift-service-ca\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.879649 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.879474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjcr6\" (UniqueName: \"kubernetes.io/projected/531a6778-4b9f-435b-bb0b-e80ef877f32d-kube-api-access-cjcr6\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.879649 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.879495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.980952 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.980918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/531a6778-4b9f-435b-bb0b-e80ef877f32d-openshift-service-ca\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.980952 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.980953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcr6\" (UniqueName: \"kubernetes.io/projected/531a6778-4b9f-435b-bb0b-e80ef877f32d-kube-api-access-cjcr6\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.981158 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.980975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.981158 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:37:05.981115    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-serving-cert: secret "maas-api-e2e-ait-b9daa40c-serving-cert" not found
Jul 15 13:37:05.981228 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:37:05.981171    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls podName:531a6778-4b9f-435b-bb0b-e80ef877f32d nodeName:}" failed. No retries permitted until 2026-07-15 13:37:06.481153297 +0000 UTC m=+1835.430170762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls") pod "maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" (UID: "531a6778-4b9f-435b-bb0b-e80ef877f32d") : secret "maas-api-e2e-ait-b9daa40c-serving-cert" not found
Jul 15 13:37:05.981592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.981571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/531a6778-4b9f-435b-bb0b-e80ef877f32d-openshift-service-ca\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:05.989957 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:05.989932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjcr6\" (UniqueName: \"kubernetes.io/projected/531a6778-4b9f-435b-bb0b-e80ef877f32d-kube-api-access-cjcr6\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:06.485092 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:06.485053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:06.487591 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:06.487559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls\") pod \"maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:06.668479 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:06.668436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:06.818088 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:06.818058    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"]
Jul 15 13:37:06.819758 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:37:06.819730    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531a6778_4b9f_435b_bb0b_e80ef877f32d.slice/crio-e56608ac2f7c2ca0eae7e2e9d65b65fdfec56126b93a178cb91f3c1f20d98c2c WatchSource:0}: Error finding container e56608ac2f7c2ca0eae7e2e9d65b65fdfec56126b93a178cb91f3c1f20d98c2c: Status 404 returned error can't find the container with id e56608ac2f7c2ca0eae7e2e9d65b65fdfec56126b93a178cb91f3c1f20d98c2c
Jul 15 13:37:07.353723 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:07.353683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" event={"ID":"531a6778-4b9f-435b-bb0b-e80ef877f32d","Type":"ContainerStarted","Data":"e56608ac2f7c2ca0eae7e2e9d65b65fdfec56126b93a178cb91f3c1f20d98c2c"}
Jul 15 13:37:08.361159 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:08.361069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" event={"ID":"531a6778-4b9f-435b-bb0b-e80ef877f32d","Type":"ContainerStarted","Data":"73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1"}
Jul 15 13:37:08.361554 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:08.361225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:37:08.386137 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:08.386078    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" podStartSLOduration=2.440327363 podStartE2EDuration="3.386057393s" totalImagesPullingTime="945.73003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:37:08.385158792 +0000 UTC m=+1837.334176302" watchObservedRunningTime="2026-07-15 13:37:08.386057393 +0000 UTC m=+1837.335074865"
Jul 15 13:37:14.372002 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:37:14.371973    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:38:11.090473 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.090440    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"]
Jul 15 13:38:11.091059 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.090804    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" podUID="531a6778-4b9f-435b-bb0b-e80ef877f32d" containerName="maas-api" containerID="cri-o://73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1" gracePeriod=30
Jul 15 13:38:11.341629 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.341566    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:38:11.472227 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.472185    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls\") pod \"531a6778-4b9f-435b-bb0b-e80ef877f32d\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") "
Jul 15 13:38:11.472456 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.472300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjcr6\" (UniqueName: \"kubernetes.io/projected/531a6778-4b9f-435b-bb0b-e80ef877f32d-kube-api-access-cjcr6\") pod \"531a6778-4b9f-435b-bb0b-e80ef877f32d\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") "
Jul 15 13:38:11.472456 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.472384    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/531a6778-4b9f-435b-bb0b-e80ef877f32d-openshift-service-ca\") pod \"531a6778-4b9f-435b-bb0b-e80ef877f32d\" (UID: \"531a6778-4b9f-435b-bb0b-e80ef877f32d\") "
Jul 15 13:38:11.472780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.472755    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a6778-4b9f-435b-bb0b-e80ef877f32d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "531a6778-4b9f-435b-bb0b-e80ef877f32d" (UID: "531a6778-4b9f-435b-bb0b-e80ef877f32d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:38:11.474414 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.474386    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "531a6778-4b9f-435b-bb0b-e80ef877f32d" (UID: "531a6778-4b9f-435b-bb0b-e80ef877f32d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:38:11.474414 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.474392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531a6778-4b9f-435b-bb0b-e80ef877f32d-kube-api-access-cjcr6" (OuterVolumeSpecName: "kube-api-access-cjcr6") pod "531a6778-4b9f-435b-bb0b-e80ef877f32d" (UID: "531a6778-4b9f-435b-bb0b-e80ef877f32d"). InnerVolumeSpecName "kube-api-access-cjcr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:38:11.573243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.573200    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/531a6778-4b9f-435b-bb0b-e80ef877f32d-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:38:11.573243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.573234    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjcr6\" (UniqueName: \"kubernetes.io/projected/531a6778-4b9f-435b-bb0b-e80ef877f32d-kube-api-access-cjcr6\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:38:11.573243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.573243    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/531a6778-4b9f-435b-bb0b-e80ef877f32d-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:38:11.694930 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.694891    2561 generic.go:356] "Generic (PLEG): container finished" podID="531a6778-4b9f-435b-bb0b-e80ef877f32d" containerID="73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1" exitCode=0
Jul 15 13:38:11.695102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.694937    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"
Jul 15 13:38:11.695102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.694978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" event={"ID":"531a6778-4b9f-435b-bb0b-e80ef877f32d","Type":"ContainerDied","Data":"73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1"}
Jul 15 13:38:11.695102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.695035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4" event={"ID":"531a6778-4b9f-435b-bb0b-e80ef877f32d","Type":"ContainerDied","Data":"e56608ac2f7c2ca0eae7e2e9d65b65fdfec56126b93a178cb91f3c1f20d98c2c"}
Jul 15 13:38:11.695102 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.695059    2561 scope.go:117] "RemoveContainer" containerID="73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1"
Jul 15 13:38:11.705916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.705895    2561 scope.go:117] "RemoveContainer" containerID="73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1"
Jul 15 13:38:11.706225 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:38:11.706198    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1\": container with ID starting with 73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1 not found: ID does not exist" containerID="73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1"
Jul 15 13:38:11.706312 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.706234    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1"} err="failed to get container status \"73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1\": rpc error: code = NotFound desc = could not find container \"73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1\": container with ID starting with 73a5735de76e6925ff09241bed7f2071c0881f2bbf8d41fc3722fb7d76bc60d1 not found: ID does not exist"
Jul 15 13:38:11.712576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.712549    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"]
Jul 15 13:38:11.719766 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:11.719739    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9daa40c-5d57d7858f-tnvs4"]
Jul 15 13:38:13.585045 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:13.585011    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531a6778-4b9f-435b-bb0b-e80ef877f32d" path="/var/lib/kubelet/pods/531a6778-4b9f-435b-bb0b-e80ef877f32d/volumes"
Jul 15 13:38:28.306960 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.306924    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"]
Jul 15 13:38:28.307521 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.307294    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a6778-4b9f-435b-bb0b-e80ef877f32d" containerName="maas-api"
Jul 15 13:38:28.307521 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.307307    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a6778-4b9f-435b-bb0b-e80ef877f32d" containerName="maas-api"
Jul 15 13:38:28.307521 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.307394    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a6778-4b9f-435b-bb0b-e80ef877f32d" containerName="maas-api"
Jul 15 13:38:28.310469 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.310444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.312947 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.312924    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c15b0ffb-serving-cert\""
Jul 15 13:38:28.321388 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.321361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"]
Jul 15 13:38:28.421407 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.421361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd34024-e201-491c-bd11-165bd8cb9131-openshift-service-ca\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.421407 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.421401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bd34024-e201-491c-bd11-165bd8cb9131-maas-api-tls\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.421622 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.421478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvvm\" (UniqueName: \"kubernetes.io/projected/4bd34024-e201-491c-bd11-165bd8cb9131-kube-api-access-2qvvm\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.522681 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.522639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvvm\" (UniqueName: \"kubernetes.io/projected/4bd34024-e201-491c-bd11-165bd8cb9131-kube-api-access-2qvvm\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.522862 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.522699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd34024-e201-491c-bd11-165bd8cb9131-openshift-service-ca\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.522862 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.522719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bd34024-e201-491c-bd11-165bd8cb9131-maas-api-tls\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.523406 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.523385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd34024-e201-491c-bd11-165bd8cb9131-openshift-service-ca\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.525038 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.525019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bd34024-e201-491c-bd11-165bd8cb9131-maas-api-tls\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.536689 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.536659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvvm\" (UniqueName: \"kubernetes.io/projected/4bd34024-e201-491c-bd11-165bd8cb9131-kube-api-access-2qvvm\") pod \"maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.623222 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.623129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:28.760850 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.760819    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"]
Jul 15 13:38:28.762437 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:38:28.762409    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd34024_e201_491c_bd11_165bd8cb9131.slice/crio-1e25ef50ee203d6b011394b15f1fbf57e460632195d39434490132a6c917fa83 WatchSource:0}: Error finding container 1e25ef50ee203d6b011394b15f1fbf57e460632195d39434490132a6c917fa83: Status 404 returned error can't find the container with id 1e25ef50ee203d6b011394b15f1fbf57e460632195d39434490132a6c917fa83
Jul 15 13:38:28.785600 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:28.785567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz" event={"ID":"4bd34024-e201-491c-bd11-165bd8cb9131","Type":"ContainerStarted","Data":"1e25ef50ee203d6b011394b15f1fbf57e460632195d39434490132a6c917fa83"}
Jul 15 13:38:30.800589 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:30.800544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz" event={"ID":"4bd34024-e201-491c-bd11-165bd8cb9131","Type":"ContainerStarted","Data":"e5b8a114aac9647781a874ea7e6ba9821ea5da0740a2366511806b11b5d29cee"}
Jul 15 13:38:30.801292 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:30.801241    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:38:30.817453 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:30.817402    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz" podStartSLOduration=1.512757035 podStartE2EDuration="2.817382908s" totalImagesPullingTime="1.304625873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:38:30.816944707 +0000 UTC m=+1919.765962179" watchObservedRunningTime="2026-07-15 13:38:30.817382908 +0000 UTC m=+1919.766400379"
Jul 15 13:38:36.811975 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:38:36.811946    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:39:43.013924 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.013889    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"]
Jul 15 13:39:43.014768 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.014728    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz" podUID="4bd34024-e201-491c-bd11-165bd8cb9131" containerName="maas-api" containerID="cri-o://e5b8a114aac9647781a874ea7e6ba9821ea5da0740a2366511806b11b5d29cee" gracePeriod=30
Jul 15 13:39:43.179035 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.178998    2561 generic.go:356] "Generic (PLEG): container finished" podID="4bd34024-e201-491c-bd11-165bd8cb9131" containerID="e5b8a114aac9647781a874ea7e6ba9821ea5da0740a2366511806b11b5d29cee" exitCode=0
Jul 15 13:39:43.179197 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.179077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz" event={"ID":"4bd34024-e201-491c-bd11-165bd8cb9131","Type":"ContainerDied","Data":"e5b8a114aac9647781a874ea7e6ba9821ea5da0740a2366511806b11b5d29cee"}
Jul 15 13:39:43.261660 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.261636    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:39:43.363427 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.363329    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qvvm\" (UniqueName: \"kubernetes.io/projected/4bd34024-e201-491c-bd11-165bd8cb9131-kube-api-access-2qvvm\") pod \"4bd34024-e201-491c-bd11-165bd8cb9131\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") "
Jul 15 13:39:43.363427 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.363384    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bd34024-e201-491c-bd11-165bd8cb9131-maas-api-tls\") pod \"4bd34024-e201-491c-bd11-165bd8cb9131\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") "
Jul 15 13:39:43.363427 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.363409    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd34024-e201-491c-bd11-165bd8cb9131-openshift-service-ca\") pod \"4bd34024-e201-491c-bd11-165bd8cb9131\" (UID: \"4bd34024-e201-491c-bd11-165bd8cb9131\") "
Jul 15 13:39:43.363788 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.363765    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd34024-e201-491c-bd11-165bd8cb9131-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4bd34024-e201-491c-bd11-165bd8cb9131" (UID: "4bd34024-e201-491c-bd11-165bd8cb9131"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:39:43.365460 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.365437    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd34024-e201-491c-bd11-165bd8cb9131-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4bd34024-e201-491c-bd11-165bd8cb9131" (UID: "4bd34024-e201-491c-bd11-165bd8cb9131"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:39:43.365629 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.365606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd34024-e201-491c-bd11-165bd8cb9131-kube-api-access-2qvvm" (OuterVolumeSpecName: "kube-api-access-2qvvm") pod "4bd34024-e201-491c-bd11-165bd8cb9131" (UID: "4bd34024-e201-491c-bd11-165bd8cb9131"). InnerVolumeSpecName "kube-api-access-2qvvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:39:43.464908 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.464869    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qvvm\" (UniqueName: \"kubernetes.io/projected/4bd34024-e201-491c-bd11-165bd8cb9131-kube-api-access-2qvvm\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:39:43.464908 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.464903    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bd34024-e201-491c-bd11-165bd8cb9131-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:39:43.464908 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:43.464913    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd34024-e201-491c-bd11-165bd8cb9131-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:39:44.185933 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:44.185894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz" event={"ID":"4bd34024-e201-491c-bd11-165bd8cb9131","Type":"ContainerDied","Data":"1e25ef50ee203d6b011394b15f1fbf57e460632195d39434490132a6c917fa83"}
Jul 15 13:39:44.185933 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:44.185925    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"
Jul 15 13:39:44.186454 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:44.185994    2561 scope.go:117] "RemoveContainer" containerID="e5b8a114aac9647781a874ea7e6ba9821ea5da0740a2366511806b11b5d29cee"
Jul 15 13:39:44.202407 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:44.202378    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"]
Jul 15 13:39:44.205656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:44.205629    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c15b0ffb-56bc766645-llnlz"]
Jul 15 13:39:45.585234 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:39:45.585199    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd34024-e201-491c-bd11-165bd8cb9131" path="/var/lib/kubelet/pods/4bd34024-e201-491c-bd11-165bd8cb9131/volumes"
Jul 15 13:41:31.633292 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:31.633242    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:41:31.635452 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:31.635429    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:41:31.639468 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:31.639448    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:41:31.641561 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:31.641542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:41:31.643000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:31.642979    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:41:31.649242 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:31.649226    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:41:38.904061 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.904022    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"]
Jul 15 13:41:38.904658 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.904635    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd34024-e201-491c-bd11-165bd8cb9131" containerName="maas-api"
Jul 15 13:41:38.904710 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.904662    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd34024-e201-491c-bd11-165bd8cb9131" containerName="maas-api"
Jul 15 13:41:38.904770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.904758    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd34024-e201-491c-bd11-165bd8cb9131" containerName="maas-api"
Jul 15 13:41:38.908138 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.908107    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:38.910742 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.910706    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b14f8bd8-serving-cert\""
Jul 15 13:41:38.920369 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:38.920343    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"]
Jul 15 13:41:39.006733 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.006690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvjpl\" (UniqueName: \"kubernetes.io/projected/ed4bd744-d70b-486a-964b-585d5f7c2883-kube-api-access-bvjpl\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.006917 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.006749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4bd744-d70b-486a-964b-585d5f7c2883-maas-api-tls\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.006917 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.006805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4bd744-d70b-486a-964b-585d5f7c2883-openshift-service-ca\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.108081 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.108045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvjpl\" (UniqueName: \"kubernetes.io/projected/ed4bd744-d70b-486a-964b-585d5f7c2883-kube-api-access-bvjpl\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.108081 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.108087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4bd744-d70b-486a-964b-585d5f7c2883-maas-api-tls\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.108391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.108131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4bd744-d70b-486a-964b-585d5f7c2883-openshift-service-ca\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.108772 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.108751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4bd744-d70b-486a-964b-585d5f7c2883-openshift-service-ca\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.110649 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.110627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4bd744-d70b-486a-964b-585d5f7c2883-maas-api-tls\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.118326 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.118301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvjpl\" (UniqueName: \"kubernetes.io/projected/ed4bd744-d70b-486a-964b-585d5f7c2883-kube-api-access-bvjpl\") pod \"maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.218713 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.218682    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:39.363787 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.363611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"]
Jul 15 13:41:39.366342 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:41:39.366312    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4bd744_d70b_486a_964b_585d5f7c2883.slice/crio-5a8b314e0d3fbe5833c9c0e368e4ac42512d7b9102ceddfeae53ea0d8ce949dd WatchSource:0}: Error finding container 5a8b314e0d3fbe5833c9c0e368e4ac42512d7b9102ceddfeae53ea0d8ce949dd: Status 404 returned error can't find the container with id 5a8b314e0d3fbe5833c9c0e368e4ac42512d7b9102ceddfeae53ea0d8ce949dd
Jul 15 13:41:39.368057 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.368037    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:41:39.792251 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:39.792206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6" event={"ID":"ed4bd744-d70b-486a-964b-585d5f7c2883","Type":"ContainerStarted","Data":"5a8b314e0d3fbe5833c9c0e368e4ac42512d7b9102ceddfeae53ea0d8ce949dd"}
Jul 15 13:41:40.798733 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:40.798696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6" event={"ID":"ed4bd744-d70b-486a-964b-585d5f7c2883","Type":"ContainerStarted","Data":"c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580"}
Jul 15 13:41:40.799123 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:40.798780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:41:40.815878 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:40.815815    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6" podStartSLOduration=2.204285856 podStartE2EDuration="2.815795842s" totalImagesPullingTime="611.509986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:41:40.814741375 +0000 UTC m=+2109.763758846" watchObservedRunningTime="2026-07-15 13:41:40.815795842 +0000 UTC m=+2109.764813314"
Jul 15 13:41:46.809765 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:41:46.809737    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:42:01.230318 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.230267    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"]
Jul 15 13:42:01.230784 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.230571    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6" podUID="ed4bd744-d70b-486a-964b-585d5f7c2883" containerName="maas-api" containerID="cri-o://c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580" gracePeriod=30
Jul 15 13:42:01.481888 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.481824    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:42:01.617586 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.617550    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4bd744-d70b-486a-964b-585d5f7c2883-openshift-service-ca\") pod \"ed4bd744-d70b-486a-964b-585d5f7c2883\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") "
Jul 15 13:42:01.617774 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.617604    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvjpl\" (UniqueName: \"kubernetes.io/projected/ed4bd744-d70b-486a-964b-585d5f7c2883-kube-api-access-bvjpl\") pod \"ed4bd744-d70b-486a-964b-585d5f7c2883\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") "
Jul 15 13:42:01.617774 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.617640    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4bd744-d70b-486a-964b-585d5f7c2883-maas-api-tls\") pod \"ed4bd744-d70b-486a-964b-585d5f7c2883\" (UID: \"ed4bd744-d70b-486a-964b-585d5f7c2883\") "
Jul 15 13:42:01.617940 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.617906    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed4bd744-d70b-486a-964b-585d5f7c2883-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed4bd744-d70b-486a-964b-585d5f7c2883" (UID: "ed4bd744-d70b-486a-964b-585d5f7c2883"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:42:01.619724 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.619702    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed4bd744-d70b-486a-964b-585d5f7c2883-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed4bd744-d70b-486a-964b-585d5f7c2883" (UID: "ed4bd744-d70b-486a-964b-585d5f7c2883"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:42:01.619814 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.619762    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4bd744-d70b-486a-964b-585d5f7c2883-kube-api-access-bvjpl" (OuterVolumeSpecName: "kube-api-access-bvjpl") pod "ed4bd744-d70b-486a-964b-585d5f7c2883" (UID: "ed4bd744-d70b-486a-964b-585d5f7c2883"). InnerVolumeSpecName "kube-api-access-bvjpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:42:01.719253 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.719219    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4bd744-d70b-486a-964b-585d5f7c2883-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:42:01.719253 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.719248    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvjpl\" (UniqueName: \"kubernetes.io/projected/ed4bd744-d70b-486a-964b-585d5f7c2883-kube-api-access-bvjpl\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:42:01.719253 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.719258    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4bd744-d70b-486a-964b-585d5f7c2883-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:42:01.922726 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.922637    2561 generic.go:356] "Generic (PLEG): container finished" podID="ed4bd744-d70b-486a-964b-585d5f7c2883" containerID="c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580" exitCode=0
Jul 15 13:42:01.922726 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.922688    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"
Jul 15 13:42:01.922916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.922728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6" event={"ID":"ed4bd744-d70b-486a-964b-585d5f7c2883","Type":"ContainerDied","Data":"c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580"}
Jul 15 13:42:01.922916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.922785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6" event={"ID":"ed4bd744-d70b-486a-964b-585d5f7c2883","Type":"ContainerDied","Data":"5a8b314e0d3fbe5833c9c0e368e4ac42512d7b9102ceddfeae53ea0d8ce949dd"}
Jul 15 13:42:01.922916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.922813    2561 scope.go:117] "RemoveContainer" containerID="c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580"
Jul 15 13:42:01.932307 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.932290    2561 scope.go:117] "RemoveContainer" containerID="c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580"
Jul 15 13:42:01.932581 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:42:01.932562    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580\": container with ID starting with c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580 not found: ID does not exist" containerID="c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580"
Jul 15 13:42:01.932637 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.932588    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580"} err="failed to get container status \"c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580\": rpc error: code = NotFound desc = could not find container \"c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580\": container with ID starting with c3ae17f789eb70bd264cc5cdaed1c8aca1a8ae51c51f187137918945c1b88580 not found: ID does not exist"
Jul 15 13:42:01.944242 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.944191    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"]
Jul 15 13:42:01.946497 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:01.946476    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b14f8bd8-86d4ffb9f5-hqtw6"]
Jul 15 13:42:03.585438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:03.585403    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed4bd744-d70b-486a-964b-585d5f7c2883" path="/var/lib/kubelet/pods/ed4bd744-d70b-486a-964b-585d5f7c2883/volumes"
Jul 15 13:42:39.084580 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.084545    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"]
Jul 15 13:42:39.085185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.085068    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4bd744-d70b-486a-964b-585d5f7c2883" containerName="maas-api"
Jul 15 13:42:39.085185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.085090    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4bd744-d70b-486a-964b-585d5f7c2883" containerName="maas-api"
Jul 15 13:42:39.085185 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.085177    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed4bd744-d70b-486a-964b-585d5f7c2883" containerName="maas-api"
Jul 15 13:42:39.088203 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.088180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.091114 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.091086    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e86098b2-serving-cert\""
Jul 15 13:42:39.099594 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.099570    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"]
Jul 15 13:42:39.163837 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.163796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/3875efdd-19c8-47fb-8cf1-2f8263cabeba-kube-api-access-qwcg2\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.163837 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.163842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3875efdd-19c8-47fb-8cf1-2f8263cabeba-openshift-service-ca\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.164101 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.163867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.265304 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.265247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3875efdd-19c8-47fb-8cf1-2f8263cabeba-openshift-service-ca\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.265481 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.265394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.265554 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:42:39.265538    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-serving-cert: secret "maas-api-e2e-mt-e86098b2-serving-cert" not found
Jul 15 13:42:39.265616 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.265542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/3875efdd-19c8-47fb-8cf1-2f8263cabeba-kube-api-access-qwcg2\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.265676 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:42:39.265616    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls podName:3875efdd-19c8-47fb-8cf1-2f8263cabeba nodeName:}" failed. No retries permitted until 2026-07-15 13:42:39.765594978 +0000 UTC m=+2168.714612442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls") pod "maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" (UID: "3875efdd-19c8-47fb-8cf1-2f8263cabeba") : secret "maas-api-e2e-mt-e86098b2-serving-cert" not found
Jul 15 13:42:39.265848 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.265830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3875efdd-19c8-47fb-8cf1-2f8263cabeba-openshift-service-ca\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.274966 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.274931    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/3875efdd-19c8-47fb-8cf1-2f8263cabeba-kube-api-access-qwcg2\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.769462 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.769418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:39.772192 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:39.772159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls\") pod \"maas-api-e2e-mt-e86098b2-867b97bb68-59zq7\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:40.000556 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:40.000507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:40.141988 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:40.141962    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"]
Jul 15 13:42:40.143552 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:42:40.143525    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3875efdd_19c8_47fb_8cf1_2f8263cabeba.slice/crio-04820290a9fb80efabe3e7c62660bff10ba3a31b938745cd9ede17c46b9fc933 WatchSource:0}: Error finding container 04820290a9fb80efabe3e7c62660bff10ba3a31b938745cd9ede17c46b9fc933: Status 404 returned error can't find the container with id 04820290a9fb80efabe3e7c62660bff10ba3a31b938745cd9ede17c46b9fc933
Jul 15 13:42:41.130695 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:41.130653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" event={"ID":"3875efdd-19c8-47fb-8cf1-2f8263cabeba","Type":"ContainerStarted","Data":"f411faf2e0f8d27329572d29345094c8800e6357b1a462f774a344740d46b906"}
Jul 15 13:42:41.130913 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:41.130716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" event={"ID":"3875efdd-19c8-47fb-8cf1-2f8263cabeba","Type":"ContainerStarted","Data":"04820290a9fb80efabe3e7c62660bff10ba3a31b938745cd9ede17c46b9fc933"}
Jul 15 13:42:41.130913 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:41.130773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:42:41.153781 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:41.153721    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" podStartSLOduration=1.7297419870000001 podStartE2EDuration="2.153702109s" totalImagesPullingTime="423.960122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:42:41.152724294 +0000 UTC m=+2170.101741791" watchObservedRunningTime="2026-07-15 13:42:41.153702109 +0000 UTC m=+2170.102719580"
Jul 15 13:42:47.141486 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:42:47.141456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:43:21.805745 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:21.805709    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"]
Jul 15 13:43:21.809180 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:21.809162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:21.811708 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:21.811683    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:43:21.817714 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:21.817685    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"]
Jul 15 13:43:21.931797 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:21.931759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d290901-37a5-4a43-80c7-f3c68f81c0c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf\" (UID: \"7d290901-37a5-4a43-80c7-f3c68f81c0c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:22.032998 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:22.032956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d290901-37a5-4a43-80c7-f3c68f81c0c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf\" (UID: \"7d290901-37a5-4a43-80c7-f3c68f81c0c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:22.033655 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:22.033633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d290901-37a5-4a43-80c7-f3c68f81c0c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf\" (UID: \"7d290901-37a5-4a43-80c7-f3c68f81c0c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:22.120807 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:22.120711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:22.258008 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:22.257970    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"]
Jul 15 13:43:22.260833 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:43:22.260788    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d290901_37a5_4a43_80c7_f3c68f81c0c7.slice/crio-630d16fdd77f262234fdd654993873da41fb3a47dd7e5fd97dac949af19a7cd0 WatchSource:0}: Error finding container 630d16fdd77f262234fdd654993873da41fb3a47dd7e5fd97dac949af19a7cd0: Status 404 returned error can't find the container with id 630d16fdd77f262234fdd654993873da41fb3a47dd7e5fd97dac949af19a7cd0
Jul 15 13:43:22.348415 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:22.348383    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf" event={"ID":"7d290901-37a5-4a43-80c7-f3c68f81c0c7","Type":"ContainerStarted","Data":"630d16fdd77f262234fdd654993873da41fb3a47dd7e5fd97dac949af19a7cd0"}
Jul 15 13:43:25.367310 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:25.367256    2561 generic.go:356] "Generic (PLEG): container finished" podID="7d290901-37a5-4a43-80c7-f3c68f81c0c7" containerID="570a63fbba40e452e13ae3f9ffa1022c79260d94df3f9f9ad91aa5904c794636" exitCode=0
Jul 15 13:43:25.367697 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:25.367349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf" event={"ID":"7d290901-37a5-4a43-80c7-f3c68f81c0c7","Type":"ContainerDied","Data":"570a63fbba40e452e13ae3f9ffa1022c79260d94df3f9f9ad91aa5904c794636"}
Jul 15 13:43:26.511047 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:26.511023    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:26.573993 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:26.573960    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d290901-37a5-4a43-80c7-f3c68f81c0c7-maas-api-service-ca\") pod \"7d290901-37a5-4a43-80c7-f3c68f81c0c7\" (UID: \"7d290901-37a5-4a43-80c7-f3c68f81c0c7\") "
Jul 15 13:43:26.574363 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:26.574339    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d290901-37a5-4a43-80c7-f3c68f81c0c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d290901-37a5-4a43-80c7-f3c68f81c0c7" (UID: "7d290901-37a5-4a43-80c7-f3c68f81c0c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:43:26.675364 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:26.675333    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d290901-37a5-4a43-80c7-f3c68f81c0c7-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:43:27.379296 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:27.379250    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf"
Jul 15 13:43:27.379475 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:27.379311    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf" event={"ID":"7d290901-37a5-4a43-80c7-f3c68f81c0c7","Type":"ContainerDied","Data":"630d16fdd77f262234fdd654993873da41fb3a47dd7e5fd97dac949af19a7cd0"}
Jul 15 13:43:27.379475 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:27.379360    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="630d16fdd77f262234fdd654993873da41fb3a47dd7e5fd97dac949af19a7cd0"
Jul 15 13:43:32.254631 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.254594    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"]
Jul 15 13:43:32.255074 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.254847    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" podUID="3875efdd-19c8-47fb-8cf1-2f8263cabeba" containerName="maas-api" containerID="cri-o://f411faf2e0f8d27329572d29345094c8800e6357b1a462f774a344740d46b906" gracePeriod=30
Jul 15 13:43:32.410465 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.410432    2561 generic.go:356] "Generic (PLEG): container finished" podID="3875efdd-19c8-47fb-8cf1-2f8263cabeba" containerID="f411faf2e0f8d27329572d29345094c8800e6357b1a462f774a344740d46b906" exitCode=0
Jul 15 13:43:32.410634 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.410505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" event={"ID":"3875efdd-19c8-47fb-8cf1-2f8263cabeba","Type":"ContainerDied","Data":"f411faf2e0f8d27329572d29345094c8800e6357b1a462f774a344740d46b906"}
Jul 15 13:43:32.509433 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.509369    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:43:32.627849 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.627816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/3875efdd-19c8-47fb-8cf1-2f8263cabeba-kube-api-access-qwcg2\") pod \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") "
Jul 15 13:43:32.628030 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.627881    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3875efdd-19c8-47fb-8cf1-2f8263cabeba-openshift-service-ca\") pod \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") "
Jul 15 13:43:32.628030 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.627922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls\") pod \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\" (UID: \"3875efdd-19c8-47fb-8cf1-2f8263cabeba\") "
Jul 15 13:43:32.628298 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.628263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3875efdd-19c8-47fb-8cf1-2f8263cabeba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3875efdd-19c8-47fb-8cf1-2f8263cabeba" (UID: "3875efdd-19c8-47fb-8cf1-2f8263cabeba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:43:32.630082 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.630051    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3875efdd-19c8-47fb-8cf1-2f8263cabeba-kube-api-access-qwcg2" (OuterVolumeSpecName: "kube-api-access-qwcg2") pod "3875efdd-19c8-47fb-8cf1-2f8263cabeba" (UID: "3875efdd-19c8-47fb-8cf1-2f8263cabeba"). InnerVolumeSpecName "kube-api-access-qwcg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:43:32.630213 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.630107    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3875efdd-19c8-47fb-8cf1-2f8263cabeba" (UID: "3875efdd-19c8-47fb-8cf1-2f8263cabeba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:43:32.728731 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.728697    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3875efdd-19c8-47fb-8cf1-2f8263cabeba-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:43:32.728731 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.728726    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/3875efdd-19c8-47fb-8cf1-2f8263cabeba-kube-api-access-qwcg2\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:43:32.728731 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:32.728736    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3875efdd-19c8-47fb-8cf1-2f8263cabeba-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:43:33.417222 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:33.417195    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"
Jul 15 13:43:33.417655 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:33.417193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7" event={"ID":"3875efdd-19c8-47fb-8cf1-2f8263cabeba","Type":"ContainerDied","Data":"04820290a9fb80efabe3e7c62660bff10ba3a31b938745cd9ede17c46b9fc933"}
Jul 15 13:43:33.417655 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:33.417336    2561 scope.go:117] "RemoveContainer" containerID="f411faf2e0f8d27329572d29345094c8800e6357b1a462f774a344740d46b906"
Jul 15 13:43:33.437461 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:33.437434    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"]
Jul 15 13:43:33.440807 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:33.440782    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e86098b2-867b97bb68-59zq7"]
Jul 15 13:43:33.585929 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:43:33.585889    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3875efdd-19c8-47fb-8cf1-2f8263cabeba" path="/var/lib/kubelet/pods/3875efdd-19c8-47fb-8cf1-2f8263cabeba/volumes"
Jul 15 13:45:28.031793 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.031706    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"]
Jul 15 13:45:28.032370 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.032215    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3875efdd-19c8-47fb-8cf1-2f8263cabeba" containerName="maas-api"
Jul 15 13:45:28.032370 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.032236    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3875efdd-19c8-47fb-8cf1-2f8263cabeba" containerName="maas-api"
Jul 15 13:45:28.032370 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.032289    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d290901-37a5-4a43-80c7-f3c68f81c0c7" containerName="revoke-keys"
Jul 15 13:45:28.032370 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.032299    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d290901-37a5-4a43-80c7-f3c68f81c0c7" containerName="revoke-keys"
Jul 15 13:45:28.032592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.032388    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d290901-37a5-4a43-80c7-f3c68f81c0c7" containerName="revoke-keys"
Jul 15 13:45:28.032592 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.032407    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3875efdd-19c8-47fb-8cf1-2f8263cabeba" containerName="maas-api"
Jul 15 13:45:28.035736 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.035711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.037776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.037749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.037894 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.037820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b28773-1974-42a3-aeec-8dd3c49a5ccd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.037894 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.037860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqdvd\" (UniqueName: \"kubernetes.io/projected/26b28773-1974-42a3-aeec-8dd3c49a5ccd-kube-api-access-xqdvd\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.038167 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.038145    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-486f14-serving-cert\""
Jul 15 13:45:28.051071 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.051043    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"]
Jul 15 13:45:28.138542 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.138506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdvd\" (UniqueName: \"kubernetes.io/projected/26b28773-1974-42a3-aeec-8dd3c49a5ccd-kube-api-access-xqdvd\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.138738 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.138574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.138738 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.138605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b28773-1974-42a3-aeec-8dd3c49a5ccd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.138867 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:45:28.138750    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-serving-cert: secret "maas-api-e2e-inf-a-486f14-serving-cert" not found
Jul 15 13:45:28.138920 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:45:28.138865    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls podName:26b28773-1974-42a3-aeec-8dd3c49a5ccd nodeName:}" failed. No retries permitted until 2026-07-15 13:45:28.638843014 +0000 UTC m=+2337.587860477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls") pod "maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" (UID: "26b28773-1974-42a3-aeec-8dd3c49a5ccd") : secret "maas-api-e2e-inf-a-486f14-serving-cert" not found
Jul 15 13:45:28.139195 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.139175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b28773-1974-42a3-aeec-8dd3c49a5ccd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.149493 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.149463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqdvd\" (UniqueName: \"kubernetes.io/projected/26b28773-1974-42a3-aeec-8dd3c49a5ccd-kube-api-access-xqdvd\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.642920 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.642880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.645456 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.645426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.649317 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.649295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:28.790446 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:28.790420    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"]
Jul 15 13:45:28.792205 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:45:28.792164    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b28773_1974_42a3_aeec_8dd3c49a5ccd.slice/crio-0a4385e8e359a7b6fd29284e6600e723e4afa203d443e417e0e7dc210973cfea WatchSource:0}: Error finding container 0a4385e8e359a7b6fd29284e6600e723e4afa203d443e417e0e7dc210973cfea: Status 404 returned error can't find the container with id 0a4385e8e359a7b6fd29284e6600e723e4afa203d443e417e0e7dc210973cfea
Jul 15 13:45:29.018343 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:29.018305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" event={"ID":"26b28773-1974-42a3-aeec-8dd3c49a5ccd","Type":"ContainerStarted","Data":"0a4385e8e359a7b6fd29284e6600e723e4afa203d443e417e0e7dc210973cfea"}
Jul 15 13:45:30.025527 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:30.025435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" event={"ID":"26b28773-1974-42a3-aeec-8dd3c49a5ccd","Type":"ContainerStarted","Data":"c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd"}
Jul 15 13:45:30.025890 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:30.025548    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:30.043725 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:30.043671    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" podStartSLOduration=1.100717504 podStartE2EDuration="2.043654452s" totalImagesPullingTime="942.936948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:45:30.042495954 +0000 UTC m=+2338.991513450" watchObservedRunningTime="2026-07-15 13:45:30.043654452 +0000 UTC m=+2338.992671924"
Jul 15 13:45:36.036767 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.036732    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:45:36.119072 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.119040    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"]
Jul 15 13:45:36.122425 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.122402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.125024 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.125000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a5d1bc-serving-cert\""
Jul 15 13:45:36.132725 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.132701    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"]
Jul 15 13:45:36.209792 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.209755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.209966 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.209798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.209966 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.209856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwjrl\" (UniqueName: \"kubernetes.io/projected/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-kube-api-access-dwjrl\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.311333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.311199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.311333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.311249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.311333 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.311321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwjrl\" (UniqueName: \"kubernetes.io/projected/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-kube-api-access-dwjrl\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.312187 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.312165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.313791 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.313769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.319902 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.319873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwjrl\" (UniqueName: \"kubernetes.io/projected/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-kube-api-access-dwjrl\") pod \"maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.434960 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.434923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:36.579469 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:36.579437    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"]
Jul 15 13:45:36.581224 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:45:36.581200    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c0086b_5c65_4ab1_958f_cfaa654bf1eb.slice/crio-f99d621c3e7f264fe3f97129881dd362b21c44d567dd0af9e390e4f3f5831dc7 WatchSource:0}: Error finding container f99d621c3e7f264fe3f97129881dd362b21c44d567dd0af9e390e4f3f5831dc7: Status 404 returned error can't find the container with id f99d621c3e7f264fe3f97129881dd362b21c44d567dd0af9e390e4f3f5831dc7
Jul 15 13:45:37.063906 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:37.063870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm" event={"ID":"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb","Type":"ContainerStarted","Data":"f99d621c3e7f264fe3f97129881dd362b21c44d567dd0af9e390e4f3f5831dc7"}
Jul 15 13:45:38.071558 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:38.071524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm" event={"ID":"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb","Type":"ContainerStarted","Data":"cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a"}
Jul 15 13:45:38.071951 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:38.071706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:45:38.091404 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:38.091353    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm" podStartSLOduration=0.709850724 podStartE2EDuration="2.091335355s" totalImagesPullingTime="1.381484631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:45:38.088733524 +0000 UTC m=+2347.037751006" watchObservedRunningTime="2026-07-15 13:45:38.091335355 +0000 UTC m=+2347.040352827"
Jul 15 13:45:44.082899 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:45:44.082869    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:46:31.670776 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:31.670739    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:46:31.673155 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:31.673134    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:46:31.677225 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:31.677196    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:46:31.687111 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:31.687064    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:46:31.689882 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:31.689861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:46:31.695809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:31.695790    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:46:45.258970 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.258931    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"]
Jul 15 13:46:45.262214 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.262197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:45.264537 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.264515    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:46:45.271135 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.271106    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"]
Jul 15 13:46:45.343394 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.343341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/676102b3-7424-4553-a09e-f54e26615264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2\" (UID: \"676102b3-7424-4553-a09e-f54e26615264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:45.444101 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.444061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/676102b3-7424-4553-a09e-f54e26615264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2\" (UID: \"676102b3-7424-4553-a09e-f54e26615264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:45.444777 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.444751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/676102b3-7424-4553-a09e-f54e26615264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2\" (UID: \"676102b3-7424-4553-a09e-f54e26615264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:45.575656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.575568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:45.713402 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:45.713354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"]
Jul 15 13:46:45.716447 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:46:45.716408    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676102b3_7424_4553_a09e_f54e26615264.slice/crio-4b3860be633a72bd2a78a316501d8155cb2eaa8ab5991d6fd8d59dcaa0443f96 WatchSource:0}: Error finding container 4b3860be633a72bd2a78a316501d8155cb2eaa8ab5991d6fd8d59dcaa0443f96: Status 404 returned error can't find the container with id 4b3860be633a72bd2a78a316501d8155cb2eaa8ab5991d6fd8d59dcaa0443f96
Jul 15 13:46:46.459495 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:46.459456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2" event={"ID":"676102b3-7424-4553-a09e-f54e26615264","Type":"ContainerStarted","Data":"4e3e70037e6c1c288a966eac5f2c8b7d8cf29e48adc5c997c64c77ec14a84b6b"}
Jul 15 13:46:46.459892 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:46.459562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2" event={"ID":"676102b3-7424-4553-a09e-f54e26615264","Type":"ContainerStarted","Data":"4b3860be633a72bd2a78a316501d8155cb2eaa8ab5991d6fd8d59dcaa0443f96"}
Jul 15 13:46:46.477199 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:46.477138    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2" podStartSLOduration=1.477121558 podStartE2EDuration="1.477121558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:46:46.474878043 +0000 UTC m=+2415.423895525" watchObservedRunningTime="2026-07-15 13:46:46.477121558 +0000 UTC m=+2415.426139028"
Jul 15 13:46:47.465772 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:47.465736    2561 generic.go:356] "Generic (PLEG): container finished" podID="676102b3-7424-4553-a09e-f54e26615264" containerID="4e3e70037e6c1c288a966eac5f2c8b7d8cf29e48adc5c997c64c77ec14a84b6b" exitCode=0
Jul 15 13:46:47.466177 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:47.465812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2" event={"ID":"676102b3-7424-4553-a09e-f54e26615264","Type":"ContainerDied","Data":"4e3e70037e6c1c288a966eac5f2c8b7d8cf29e48adc5c997c64c77ec14a84b6b"}
Jul 15 13:46:48.602534 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:48.602503    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:48.776158 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:48.776073    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/676102b3-7424-4553-a09e-f54e26615264-maas-api-service-ca\") pod \"676102b3-7424-4553-a09e-f54e26615264\" (UID: \"676102b3-7424-4553-a09e-f54e26615264\") "
Jul 15 13:46:48.776489 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:48.776464    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/676102b3-7424-4553-a09e-f54e26615264-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "676102b3-7424-4553-a09e-f54e26615264" (UID: "676102b3-7424-4553-a09e-f54e26615264"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:46:48.877100 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:48.877065    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/676102b3-7424-4553-a09e-f54e26615264-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:46:49.478284 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:49.478252    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2"
Jul 15 13:46:49.478464 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:49.478255    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2" event={"ID":"676102b3-7424-4553-a09e-f54e26615264","Type":"ContainerDied","Data":"4b3860be633a72bd2a78a316501d8155cb2eaa8ab5991d6fd8d59dcaa0443f96"}
Jul 15 13:46:49.478464 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:49.478398    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b3860be633a72bd2a78a316501d8155cb2eaa8ab5991d6fd8d59dcaa0443f96"
Jul 15 13:46:55.824154 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:55.824118    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"]
Jul 15 13:46:55.824651 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:55.824361    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" podUID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" containerName="maas-api" containerID="cri-o://c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd" gracePeriod=30
Jul 15 13:46:56.078748 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.078683    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:46:56.142856 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.142824    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqdvd\" (UniqueName: \"kubernetes.io/projected/26b28773-1974-42a3-aeec-8dd3c49a5ccd-kube-api-access-xqdvd\") pod \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") "
Jul 15 13:46:56.142856 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.142862    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b28773-1974-42a3-aeec-8dd3c49a5ccd-openshift-service-ca\") pod \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") "
Jul 15 13:46:56.143119 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.142907    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls\") pod \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\" (UID: \"26b28773-1974-42a3-aeec-8dd3c49a5ccd\") "
Jul 15 13:46:56.143220 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.143195    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26b28773-1974-42a3-aeec-8dd3c49a5ccd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26b28773-1974-42a3-aeec-8dd3c49a5ccd" (UID: "26b28773-1974-42a3-aeec-8dd3c49a5ccd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:46:56.145080 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.145046    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26b28773-1974-42a3-aeec-8dd3c49a5ccd" (UID: "26b28773-1974-42a3-aeec-8dd3c49a5ccd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:46:56.145206 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.145155    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b28773-1974-42a3-aeec-8dd3c49a5ccd-kube-api-access-xqdvd" (OuterVolumeSpecName: "kube-api-access-xqdvd") pod "26b28773-1974-42a3-aeec-8dd3c49a5ccd" (UID: "26b28773-1974-42a3-aeec-8dd3c49a5ccd"). InnerVolumeSpecName "kube-api-access-xqdvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:46:56.243874 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.243839    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26b28773-1974-42a3-aeec-8dd3c49a5ccd-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:46:56.243874 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.243871    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqdvd\" (UniqueName: \"kubernetes.io/projected/26b28773-1974-42a3-aeec-8dd3c49a5ccd-kube-api-access-xqdvd\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:46:56.243874 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.243883    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b28773-1974-42a3-aeec-8dd3c49a5ccd-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:46:56.514966 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.514929    2561 generic.go:356] "Generic (PLEG): container finished" podID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" containerID="c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd" exitCode=0
Jul 15 13:46:56.515179 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.514977    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"
Jul 15 13:46:56.515179 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.515009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" event={"ID":"26b28773-1974-42a3-aeec-8dd3c49a5ccd","Type":"ContainerDied","Data":"c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd"}
Jul 15 13:46:56.515179 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.515069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" event={"ID":"26b28773-1974-42a3-aeec-8dd3c49a5ccd","Type":"ContainerDied","Data":"0a4385e8e359a7b6fd29284e6600e723e4afa203d443e417e0e7dc210973cfea"}
Jul 15 13:46:56.515179 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.515098    2561 scope.go:117] "RemoveContainer" containerID="c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd"
Jul 15 13:46:56.524971 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.524954    2561 scope.go:117] "RemoveContainer" containerID="c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd"
Jul 15 13:46:56.525229 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:46:56.525210    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd\": container with ID starting with c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd not found: ID does not exist" containerID="c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd"
Jul 15 13:46:56.525304 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.525240    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd"} err="failed to get container status \"c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd\": rpc error: code = NotFound desc = could not find container \"c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd\": container with ID starting with c0790f243be9d094f8e1267ac5252a0c3859a8fbc82b2a8c28925da586ebbffd not found: ID does not exist"
Jul 15 13:46:56.537442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.537406    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"]
Jul 15 13:46:56.541093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:56.541069    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv"]
Jul 15 13:46:57.590818 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:57.590780    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" path="/var/lib/kubelet/pods/26b28773-1974-42a3-aeec-8dd3c49a5ccd/volumes"
Jul 15 13:46:59.032443 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:46:59.032388    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-486f14-b87bc7ff-jphmv" podUID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.55:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 15 13:47:11.394935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.394896    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"]
Jul 15 13:47:11.395421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.395262    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="676102b3-7424-4553-a09e-f54e26615264" containerName="revoke-keys"
Jul 15 13:47:11.395421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.395290    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="676102b3-7424-4553-a09e-f54e26615264" containerName="revoke-keys"
Jul 15 13:47:11.395421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.395308    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" containerName="maas-api"
Jul 15 13:47:11.395421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.395314    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" containerName="maas-api"
Jul 15 13:47:11.395421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.395375    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b28773-1974-42a3-aeec-8dd3c49a5ccd" containerName="maas-api"
Jul 15 13:47:11.395421 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.395385    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="676102b3-7424-4553-a09e-f54e26615264" containerName="revoke-keys"
Jul 15 13:47:11.398304 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.398287    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:11.400971 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.400949    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:47:11.406181 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.406122    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"]
Jul 15 13:47:11.473917 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.473878    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad08b1b1-60a7-4b5b-886e-6c5180dfc00c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd\" (UID: \"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:11.574578 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.574544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad08b1b1-60a7-4b5b-886e-6c5180dfc00c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd\" (UID: \"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:11.575259 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.575235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad08b1b1-60a7-4b5b-886e-6c5180dfc00c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd\" (UID: \"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:11.709981 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.709933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:11.845942 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:11.845909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"]
Jul 15 13:47:11.847840 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:47:11.847814    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad08b1b1_60a7_4b5b_886e_6c5180dfc00c.slice/crio-aea91ecd55061efe60ed8f73911da815e3d391182e4c897551422a09a0194bb9 WatchSource:0}: Error finding container aea91ecd55061efe60ed8f73911da815e3d391182e4c897551422a09a0194bb9: Status 404 returned error can't find the container with id aea91ecd55061efe60ed8f73911da815e3d391182e4c897551422a09a0194bb9
Jul 15 13:47:12.606210 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:12.606175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd" event={"ID":"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c","Type":"ContainerStarted","Data":"8d084ae86945f089e1f51026826a9e7f7690c3dd2fc811d3a36a90d73efe49bf"}
Jul 15 13:47:12.606630 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:12.606227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd" event={"ID":"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c","Type":"ContainerStarted","Data":"aea91ecd55061efe60ed8f73911da815e3d391182e4c897551422a09a0194bb9"}
Jul 15 13:47:12.622826 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:12.622760    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd" podStartSLOduration=1.622742987 podStartE2EDuration="1.622742987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:47:12.621465778 +0000 UTC m=+2441.570483267" watchObservedRunningTime="2026-07-15 13:47:12.622742987 +0000 UTC m=+2441.571760457"
Jul 15 13:47:13.612851 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:13.612814    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad08b1b1-60a7-4b5b-886e-6c5180dfc00c" containerID="8d084ae86945f089e1f51026826a9e7f7690c3dd2fc811d3a36a90d73efe49bf" exitCode=0
Jul 15 13:47:13.613243 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:13.612899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd" event={"ID":"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c","Type":"ContainerDied","Data":"8d084ae86945f089e1f51026826a9e7f7690c3dd2fc811d3a36a90d73efe49bf"}
Jul 15 13:47:14.756254 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:14.756226    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:14.803588 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:14.803562    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad08b1b1-60a7-4b5b-886e-6c5180dfc00c-maas-api-service-ca\") pod \"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c\" (UID: \"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c\") "
Jul 15 13:47:14.803951 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:14.803929    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad08b1b1-60a7-4b5b-886e-6c5180dfc00c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad08b1b1-60a7-4b5b-886e-6c5180dfc00c" (UID: "ad08b1b1-60a7-4b5b-886e-6c5180dfc00c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:47:14.904344 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:14.904234    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad08b1b1-60a7-4b5b-886e-6c5180dfc00c-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:47:15.624883 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:15.624856    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd"
Jul 15 13:47:15.625049 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:15.624900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd" event={"ID":"ad08b1b1-60a7-4b5b-886e-6c5180dfc00c","Type":"ContainerDied","Data":"aea91ecd55061efe60ed8f73911da815e3d391182e4c897551422a09a0194bb9"}
Jul 15 13:47:15.625049 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:15.624947    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aea91ecd55061efe60ed8f73911da815e3d391182e4c897551422a09a0194bb9"
Jul 15 13:47:21.936164 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:21.936118    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"]
Jul 15 13:47:21.936635 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:21.936432    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm" podUID="d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" containerName="maas-api" containerID="cri-o://cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a" gracePeriod=30
Jul 15 13:47:22.194047 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.193973    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:47:22.275338 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.275268    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-maas-api-tls\") pod \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") "
Jul 15 13:47:22.275531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.275369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwjrl\" (UniqueName: \"kubernetes.io/projected/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-kube-api-access-dwjrl\") pod \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") "
Jul 15 13:47:22.275531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.275442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-openshift-service-ca\") pod \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\" (UID: \"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb\") "
Jul 15 13:47:22.275808 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.275781    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" (UID: "d6c0086b-5c65-4ab1-958f-cfaa654bf1eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:47:22.277291 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.277253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" (UID: "d6c0086b-5c65-4ab1-958f-cfaa654bf1eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:47:22.277398 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.277367    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-kube-api-access-dwjrl" (OuterVolumeSpecName: "kube-api-access-dwjrl") pod "d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" (UID: "d6c0086b-5c65-4ab1-958f-cfaa654bf1eb"). InnerVolumeSpecName "kube-api-access-dwjrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:47:22.376086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.376046    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:47:22.376086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.376078    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:47:22.376086 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.376087    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwjrl\" (UniqueName: \"kubernetes.io/projected/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb-kube-api-access-dwjrl\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:47:22.666022 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.665930    2561 generic.go:356] "Generic (PLEG): container finished" podID="d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" containerID="cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a" exitCode=0
Jul 15 13:47:22.666022 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.665974    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"
Jul 15 13:47:22.666201 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.666022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm" event={"ID":"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb","Type":"ContainerDied","Data":"cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a"}
Jul 15 13:47:22.666201 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.666078    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm" event={"ID":"d6c0086b-5c65-4ab1-958f-cfaa654bf1eb","Type":"ContainerDied","Data":"f99d621c3e7f264fe3f97129881dd362b21c44d567dd0af9e390e4f3f5831dc7"}
Jul 15 13:47:22.666201 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.666105    2561 scope.go:117] "RemoveContainer" containerID="cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a"
Jul 15 13:47:22.680444 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.680420    2561 scope.go:117] "RemoveContainer" containerID="cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a"
Jul 15 13:47:22.680769 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:47:22.680750    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a\": container with ID starting with cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a not found: ID does not exist" containerID="cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a"
Jul 15 13:47:22.680838 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.680776    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a"} err="failed to get container status \"cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a\": rpc error: code = NotFound desc = could not find container \"cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a\": container with ID starting with cf84adec8cc966b34bf1c650ff6beb5143f0ed4872e98b749083c7ea05198f7a not found: ID does not exist"
Jul 15 13:47:22.690812 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.690784    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"]
Jul 15 13:47:22.694852 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:22.694819    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a5d1bc-6bfd8998d7-rd8lm"]
Jul 15 13:47:23.585439 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:23.585394    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" path="/var/lib/kubelet/pods/d6c0086b-5c65-4ab1-958f-cfaa654bf1eb/volumes"
Jul 15 13:47:40.724248 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724199    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"]
Jul 15 13:47:40.724753 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724731    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" containerName="maas-api"
Jul 15 13:47:40.724828 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724757    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" containerName="maas-api"
Jul 15 13:47:40.724828 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724774    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad08b1b1-60a7-4b5b-886e-6c5180dfc00c" containerName="revoke-keys"
Jul 15 13:47:40.724828 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724782    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad08b1b1-60a7-4b5b-886e-6c5180dfc00c" containerName="revoke-keys"
Jul 15 13:47:40.724983 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724888    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad08b1b1-60a7-4b5b-886e-6c5180dfc00c" containerName="revoke-keys"
Jul 15 13:47:40.724983 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.724905    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6c0086b-5c65-4ab1-958f-cfaa654bf1eb" containerName="maas-api"
Jul 15 13:47:40.727718 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.727694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.730200 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.730177    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-23e666-serving-cert\""
Jul 15 13:47:40.738977 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.738953    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"]
Jul 15 13:47:40.750938 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.750906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-openshift-service-ca\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.751177 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.751149    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgd74\" (UniqueName: \"kubernetes.io/projected/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-kube-api-access-vgd74\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.751291 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.751186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-maas-api-tls\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.852089 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.852047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgd74\" (UniqueName: \"kubernetes.io/projected/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-kube-api-access-vgd74\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.852089 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.852086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-maas-api-tls\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.852372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.852158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-openshift-service-ca\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.852833 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.852810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-openshift-service-ca\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.854699 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.854674    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-maas-api-tls\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:40.861442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:40.861418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgd74\" (UniqueName: \"kubernetes.io/projected/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-kube-api-access-vgd74\") pod \"maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:41.038506 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:41.038420    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:41.183817 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:41.183786    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"]
Jul 15 13:47:41.184374 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:47:41.184348    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadac3bb_7e78_4ea9_b786_c6b9c59b4b77.slice/crio-3133ee63f3155dbc12ed9b00c3bb337e9f37778d2376cbb81db321ed0ec158fb WatchSource:0}: Error finding container 3133ee63f3155dbc12ed9b00c3bb337e9f37778d2376cbb81db321ed0ec158fb: Status 404 returned error can't find the container with id 3133ee63f3155dbc12ed9b00c3bb337e9f37778d2376cbb81db321ed0ec158fb
Jul 15 13:47:41.185661 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:41.185640    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:47:41.772439 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:41.772404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc" event={"ID":"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77","Type":"ContainerStarted","Data":"3133ee63f3155dbc12ed9b00c3bb337e9f37778d2376cbb81db321ed0ec158fb"}
Jul 15 13:47:42.778942 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:42.778898    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc" event={"ID":"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77","Type":"ContainerStarted","Data":"ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919"}
Jul 15 13:47:42.779431 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:42.779021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:42.797734 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:42.797683    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc" podStartSLOduration=2.130278511 podStartE2EDuration="2.797668167s" totalImagesPullingTime="667.389656ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:47:42.796783162 +0000 UTC m=+2471.745800630" watchObservedRunningTime="2026-07-15 13:47:42.797668167 +0000 UTC m=+2471.746685638"
Jul 15 13:47:48.789638 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.789607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:47:48.860536 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.860500    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"]
Jul 15 13:47:48.872399 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.872355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:48.875237 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.875187    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-929ef6-serving-cert\""
Jul 15 13:47:48.875990 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.875961    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"]
Jul 15 13:47:48.927665 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.927625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-maas-api-tls\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:48.927846 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.927683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-openshift-service-ca\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:48.927846 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:48.927799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd75d\" (UniqueName: \"kubernetes.io/projected/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-kube-api-access-cd75d\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.028215 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.028179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-maas-api-tls\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.028407 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.028234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-openshift-service-ca\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.028407 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.028301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd75d\" (UniqueName: \"kubernetes.io/projected/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-kube-api-access-cd75d\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.028979 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.028951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-openshift-service-ca\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.030598 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.030572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-maas-api-tls\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.035704 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.035686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd75d\" (UniqueName: \"kubernetes.io/projected/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-kube-api-access-cd75d\") pod \"maas-api-e2e-api-b-929ef6-79f9b565-bchg8\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.184892 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.184861    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:49.327790 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.327761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"]
Jul 15 13:47:49.818940 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:49.818908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8" event={"ID":"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b","Type":"ContainerStarted","Data":"944e407a9d097f4c1b6bf0d19fde02edba25e926284339e2881b57c79cfa492b"}
Jul 15 13:47:50.827157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:50.827117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8" event={"ID":"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b","Type":"ContainerStarted","Data":"3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5"}
Jul 15 13:47:50.827573 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:50.827182    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:47:50.848288 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:50.848221    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8" podStartSLOduration=2.404990818 podStartE2EDuration="2.848205083s" totalImagesPullingTime="443.214265ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:47:50.847371197 +0000 UTC m=+2479.796388681" watchObservedRunningTime="2026-07-15 13:47:50.848205083 +0000 UTC m=+2479.797222602"
Jul 15 13:47:56.837950 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:47:56.837920    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:48:01.201451 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.201411    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"]
Jul 15 13:48:01.205048 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.205029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:01.207842 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.207820    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:48:01.212879 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.212855    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"]
Jul 15 13:48:01.341880 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.341847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4ebde5-24a0-4e3c-b977-03a6e78f6a17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-23e666-nsrv2\" (UID: \"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:01.442651 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.442597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4ebde5-24a0-4e3c-b977-03a6e78f6a17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-23e666-nsrv2\" (UID: \"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:01.443245 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.443221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4ebde5-24a0-4e3c-b977-03a6e78f6a17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-23e666-nsrv2\" (UID: \"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:01.518329 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.518225    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:01.655441 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.655399    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"]
Jul 15 13:48:01.656630 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:48:01.656606    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4ebde5_24a0_4e3c_b977_03a6e78f6a17.slice/crio-92e624ae41d1a3abc45159d0f98b8a95f3ba925c2a8c7884162095d36484a3b1 WatchSource:0}: Error finding container 92e624ae41d1a3abc45159d0f98b8a95f3ba925c2a8c7884162095d36484a3b1: Status 404 returned error can't find the container with id 92e624ae41d1a3abc45159d0f98b8a95f3ba925c2a8c7884162095d36484a3b1
Jul 15 13:48:01.888993 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:01.888952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2" event={"ID":"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17","Type":"ContainerStarted","Data":"92e624ae41d1a3abc45159d0f98b8a95f3ba925c2a8c7884162095d36484a3b1"}
Jul 15 13:48:02.895635 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:02.895602    2561 generic.go:356] "Generic (PLEG): container finished" podID="5e4ebde5-24a0-4e3c-b977-03a6e78f6a17" containerID="331668105d0c2cf88fa905ba9a75c57646a5e4a7229e4c167e2cb5a6f4c8a29c" exitCode=0
Jul 15 13:48:02.896016 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:02.895691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2" event={"ID":"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17","Type":"ContainerDied","Data":"331668105d0c2cf88fa905ba9a75c57646a5e4a7229e4c167e2cb5a6f4c8a29c"}
Jul 15 13:48:04.037746 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.037722    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:04.169446 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.169342    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4ebde5-24a0-4e3c-b977-03a6e78f6a17-maas-api-service-ca\") pod \"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17\" (UID: \"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17\") "
Jul 15 13:48:04.169718 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.169694    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4ebde5-24a0-4e3c-b977-03a6e78f6a17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e4ebde5-24a0-4e3c-b977-03a6e78f6a17" (UID: "5e4ebde5-24a0-4e3c-b977-03a6e78f6a17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:48:04.270743 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.270709    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4ebde5-24a0-4e3c-b977-03a6e78f6a17-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:04.908391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.908362    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2"
Jul 15 13:48:04.908391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.908372    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23e666-nsrv2" event={"ID":"5e4ebde5-24a0-4e3c-b977-03a6e78f6a17","Type":"ContainerDied","Data":"92e624ae41d1a3abc45159d0f98b8a95f3ba925c2a8c7884162095d36484a3b1"}
Jul 15 13:48:04.908599 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:04.908416    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92e624ae41d1a3abc45159d0f98b8a95f3ba925c2a8c7884162095d36484a3b1"
Jul 15 13:48:12.089939 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.089901    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"]
Jul 15 13:48:12.090455 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.090172    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc" podUID="eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" containerName="maas-api" containerID="cri-o://ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919" gracePeriod=30
Jul 15 13:48:12.345129 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.345069    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:48:12.448902 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.448865    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgd74\" (UniqueName: \"kubernetes.io/projected/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-kube-api-access-vgd74\") pod \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") "
Jul 15 13:48:12.449093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.448918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-maas-api-tls\") pod \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") "
Jul 15 13:48:12.449093 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.448948    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-openshift-service-ca\") pod \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\" (UID: \"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77\") "
Jul 15 13:48:12.449427 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.449402    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" (UID: "eadac3bb-7e78-4ea9-b786-c6b9c59b4b77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:48:12.451051 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.451022    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" (UID: "eadac3bb-7e78-4ea9-b786-c6b9c59b4b77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:48:12.451145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.451121    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-kube-api-access-vgd74" (OuterVolumeSpecName: "kube-api-access-vgd74") pod "eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" (UID: "eadac3bb-7e78-4ea9-b786-c6b9c59b4b77"). InnerVolumeSpecName "kube-api-access-vgd74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:48:12.550486 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.550447    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgd74\" (UniqueName: \"kubernetes.io/projected/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-kube-api-access-vgd74\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:12.550486 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.550479    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:12.550486 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.550488    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:12.952480 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.952436    2561 generic.go:356] "Generic (PLEG): container finished" podID="eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" containerID="ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919" exitCode=0
Jul 15 13:48:12.952480 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.952486    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"
Jul 15 13:48:12.952692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.952525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc" event={"ID":"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77","Type":"ContainerDied","Data":"ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919"}
Jul 15 13:48:12.952692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.952585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc" event={"ID":"eadac3bb-7e78-4ea9-b786-c6b9c59b4b77","Type":"ContainerDied","Data":"3133ee63f3155dbc12ed9b00c3bb337e9f37778d2376cbb81db321ed0ec158fb"}
Jul 15 13:48:12.952692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.952607    2561 scope.go:117] "RemoveContainer" containerID="ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919"
Jul 15 13:48:12.962157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.962139    2561 scope.go:117] "RemoveContainer" containerID="ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919"
Jul 15 13:48:12.962439 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:48:12.962417    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919\": container with ID starting with ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919 not found: ID does not exist" containerID="ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919"
Jul 15 13:48:12.962494 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.962448    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919"} err="failed to get container status \"ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919\": rpc error: code = NotFound desc = could not find container \"ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919\": container with ID starting with ea458adc20893a8c6afc7b12a9b7c3c59f7ccfb0caa1e8996e182e4c48b0a919 not found: ID does not exist"
Jul 15 13:48:12.973932 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.973907    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"]
Jul 15 13:48:12.977536 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:12.977504    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23e666-6d8f5b584c-8vctc"]
Jul 15 13:48:13.584978 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:13.584939    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" path="/var/lib/kubelet/pods/eadac3bb-7e78-4ea9-b786-c6b9c59b4b77/volumes"
Jul 15 13:48:27.324210 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324120    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"]
Jul 15 13:48:27.324780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324498    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4ebde5-24a0-4e3c-b977-03a6e78f6a17" containerName="revoke-keys"
Jul 15 13:48:27.324780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324509    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4ebde5-24a0-4e3c-b977-03a6e78f6a17" containerName="revoke-keys"
Jul 15 13:48:27.324780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324517    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" containerName="maas-api"
Jul 15 13:48:27.324780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324522    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" containerName="maas-api"
Jul 15 13:48:27.324780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324585    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eadac3bb-7e78-4ea9-b786-c6b9c59b4b77" containerName="maas-api"
Jul 15 13:48:27.324780 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.324593    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4ebde5-24a0-4e3c-b977-03a6e78f6a17" containerName="revoke-keys"
Jul 15 13:48:27.329153 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.329133    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:27.332061 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.332031    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:48:27.335139 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.335108    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"]
Jul 15 13:48:27.379552 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.379515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/329c9aea-5ced-4eac-9f11-586b8427b3a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2\" (UID: \"329c9aea-5ced-4eac-9f11-586b8427b3a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:27.480532 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.480491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/329c9aea-5ced-4eac-9f11-586b8427b3a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2\" (UID: \"329c9aea-5ced-4eac-9f11-586b8427b3a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:27.481134 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.481113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/329c9aea-5ced-4eac-9f11-586b8427b3a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2\" (UID: \"329c9aea-5ced-4eac-9f11-586b8427b3a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:27.642015 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.641918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:27.780137 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:27.780094    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"]
Jul 15 13:48:27.782125 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:48:27.782097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329c9aea_5ced_4eac_9f11_586b8427b3a6.slice/crio-463eeb8899527978546bd0215c9f1b9e50c39a4507086535a0ece4ed4782b81b WatchSource:0}: Error finding container 463eeb8899527978546bd0215c9f1b9e50c39a4507086535a0ece4ed4782b81b: Status 404 returned error can't find the container with id 463eeb8899527978546bd0215c9f1b9e50c39a4507086535a0ece4ed4782b81b
Jul 15 13:48:28.039534 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:28.039496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2" event={"ID":"329c9aea-5ced-4eac-9f11-586b8427b3a6","Type":"ContainerStarted","Data":"b773df7f6200b3f91eff8f8b84eb3d650e730493fe34ae81411920de9ab6b055"}
Jul 15 13:48:28.039700 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:28.039553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2" event={"ID":"329c9aea-5ced-4eac-9f11-586b8427b3a6","Type":"ContainerStarted","Data":"463eeb8899527978546bd0215c9f1b9e50c39a4507086535a0ece4ed4782b81b"}
Jul 15 13:48:28.055145 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:28.055087    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2" podStartSLOduration=1.055067946 podStartE2EDuration="1.055067946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:48:28.0544401 +0000 UTC m=+2517.003457573" watchObservedRunningTime="2026-07-15 13:48:28.055067946 +0000 UTC m=+2517.004085418"
Jul 15 13:48:29.047461 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:29.047430    2561 generic.go:356] "Generic (PLEG): container finished" podID="329c9aea-5ced-4eac-9f11-586b8427b3a6" containerID="b773df7f6200b3f91eff8f8b84eb3d650e730493fe34ae81411920de9ab6b055" exitCode=0
Jul 15 13:48:29.047840 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:29.047517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2" event={"ID":"329c9aea-5ced-4eac-9f11-586b8427b3a6","Type":"ContainerDied","Data":"b773df7f6200b3f91eff8f8b84eb3d650e730493fe34ae81411920de9ab6b055"}
Jul 15 13:48:30.186860 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:30.186821    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:30.198656 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:30.198625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/329c9aea-5ced-4eac-9f11-586b8427b3a6-maas-api-service-ca\") pod \"329c9aea-5ced-4eac-9f11-586b8427b3a6\" (UID: \"329c9aea-5ced-4eac-9f11-586b8427b3a6\") "
Jul 15 13:48:30.198987 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:30.198966    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329c9aea-5ced-4eac-9f11-586b8427b3a6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "329c9aea-5ced-4eac-9f11-586b8427b3a6" (UID: "329c9aea-5ced-4eac-9f11-586b8427b3a6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:48:30.300092 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:30.300047    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/329c9aea-5ced-4eac-9f11-586b8427b3a6-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:31.061150 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:31.061122    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2"
Jul 15 13:48:31.061343 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:31.061122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2" event={"ID":"329c9aea-5ced-4eac-9f11-586b8427b3a6","Type":"ContainerDied","Data":"463eeb8899527978546bd0215c9f1b9e50c39a4507086535a0ece4ed4782b81b"}
Jul 15 13:48:31.061343 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:31.061248    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="463eeb8899527978546bd0215c9f1b9e50c39a4507086535a0ece4ed4782b81b"
Jul 15 13:48:37.797270 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:37.797232    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"]
Jul 15 13:48:37.797761 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:37.797507    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8" podUID="dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" containerName="maas-api" containerID="cri-o://3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5" gracePeriod=30
Jul 15 13:48:38.047482 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.047416    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:48:38.070236 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.070205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd75d\" (UniqueName: \"kubernetes.io/projected/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-kube-api-access-cd75d\") pod \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") "
Jul 15 13:48:38.070441 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.070248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-maas-api-tls\") pod \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") "
Jul 15 13:48:38.070441 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.070343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-openshift-service-ca\") pod \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\" (UID: \"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b\") "
Jul 15 13:48:38.070718 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.070693    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" (UID: "dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:48:38.072521 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.072495    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-kube-api-access-cd75d" (OuterVolumeSpecName: "kube-api-access-cd75d") pod "dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" (UID: "dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b"). InnerVolumeSpecName "kube-api-access-cd75d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:48:38.072623 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.072611    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" (UID: "dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:48:38.117228 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.117194    2561 generic.go:356] "Generic (PLEG): container finished" podID="dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" containerID="3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5" exitCode=0
Jul 15 13:48:38.117467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.117257    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"
Jul 15 13:48:38.117467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.117301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8" event={"ID":"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b","Type":"ContainerDied","Data":"3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5"}
Jul 15 13:48:38.117467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.117364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8" event={"ID":"dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b","Type":"ContainerDied","Data":"944e407a9d097f4c1b6bf0d19fde02edba25e926284339e2881b57c79cfa492b"}
Jul 15 13:48:38.117467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.117390    2561 scope.go:117] "RemoveContainer" containerID="3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5"
Jul 15 13:48:38.127416 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.127397    2561 scope.go:117] "RemoveContainer" containerID="3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5"
Jul 15 13:48:38.127728 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:48:38.127706    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5\": container with ID starting with 3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5 not found: ID does not exist" containerID="3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5"
Jul 15 13:48:38.127839 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.127734    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5"} err="failed to get container status \"3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5\": rpc error: code = NotFound desc = could not find container \"3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5\": container with ID starting with 3be80cea2cd896252a70543cc5ed7139cd59984bfbb9b12e0d86f1354aeb07f5 not found: ID does not exist"
Jul 15 13:48:38.140225 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.140199    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"]
Jul 15 13:48:38.142438 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.142415    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-929ef6-79f9b565-bchg8"]
Jul 15 13:48:38.171496 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.171471    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:38.171496 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.171495    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd75d\" (UniqueName: \"kubernetes.io/projected/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-kube-api-access-cd75d\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:38.171654 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:38.171506    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:48:39.590335 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:39.590299    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" path="/var/lib/kubelet/pods/dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b/volumes"
Jul 15 13:48:57.214214 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214171    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"]
Jul 15 13:48:57.214726 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214689    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329c9aea-5ced-4eac-9f11-586b8427b3a6" containerName="revoke-keys"
Jul 15 13:48:57.214726 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214712    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="329c9aea-5ced-4eac-9f11-586b8427b3a6" containerName="revoke-keys"
Jul 15 13:48:57.214843 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214739    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" containerName="maas-api"
Jul 15 13:48:57.214843 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214749    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" containerName="maas-api"
Jul 15 13:48:57.214935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214844    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="329c9aea-5ced-4eac-9f11-586b8427b3a6" containerName="revoke-keys"
Jul 15 13:48:57.214935 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.214860    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbd0bc3-3ec5-424f-9894-39dc3ef39d3b" containerName="maas-api"
Jul 15 13:48:57.219152 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.219131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.221589 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.221568    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7abf62-serving-cert\""
Jul 15 13:48:57.230240 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.230213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"]
Jul 15 13:48:57.345299 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.345246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-maas-api-tls\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.345555 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.345316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.345555 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.345436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwq26\" (UniqueName: \"kubernetes.io/projected/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-kube-api-access-dwq26\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.446415 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.446371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwq26\" (UniqueName: \"kubernetes.io/projected/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-kube-api-access-dwq26\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.446619 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.446539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-maas-api-tls\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.446619 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.446594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.447553 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.447528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.452605 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.450128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-maas-api-tls\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.455174 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.455152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwq26\" (UniqueName: \"kubernetes.io/projected/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-kube-api-access-dwq26\") pod \"maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.531336 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.531229    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:57.666931 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:57.666904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"]
Jul 15 13:48:57.668654 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:48:57.668620    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6c32aa_dfb9_456a_a8f6_ba8579a7e582.slice/crio-fb5cea9c89e463698029bb3aee6c89d00a10aadb2bf078adab28a84586e9feb4 WatchSource:0}: Error finding container fb5cea9c89e463698029bb3aee6c89d00a10aadb2bf078adab28a84586e9feb4: Status 404 returned error can't find the container with id fb5cea9c89e463698029bb3aee6c89d00a10aadb2bf078adab28a84586e9feb4
Jul 15 13:48:58.229131 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:58.229093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz" event={"ID":"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582","Type":"ContainerStarted","Data":"4b9ebe2c6637ee2fa8ac5584df639b5ff0804b8db237f3041972edcde4dca833"}
Jul 15 13:48:58.229537 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:58.229165    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:48:58.229537 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:58.229189    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz" event={"ID":"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582","Type":"ContainerStarted","Data":"fb5cea9c89e463698029bb3aee6c89d00a10aadb2bf078adab28a84586e9feb4"}
Jul 15 13:48:58.247891 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:48:58.247837    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz" podStartSLOduration=0.779819281 podStartE2EDuration="1.247819857s" totalImagesPullingTime="468.000576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:48:58.244800157 +0000 UTC m=+2547.193817627" watchObservedRunningTime="2026-07-15 13:48:58.247819857 +0000 UTC m=+2547.196837331"
Jul 15 13:49:04.240786 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:04.240749    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:49:05.421242 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.421206    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"]
Jul 15 13:49:05.424953 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.424934    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.427391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.427372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bc6fa6-serving-cert\""
Jul 15 13:49:05.436786 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.436762    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"]
Jul 15 13:49:05.517345 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.517306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d108eaee-f5f1-4bcb-86e7-6e93dd900106-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.517524 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.517358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd5rr\" (UniqueName: \"kubernetes.io/projected/d108eaee-f5f1-4bcb-86e7-6e93dd900106-kube-api-access-gd5rr\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.517524 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.517423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.618360 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.618321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d108eaee-f5f1-4bcb-86e7-6e93dd900106-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.618543 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.618374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd5rr\" (UniqueName: \"kubernetes.io/projected/d108eaee-f5f1-4bcb-86e7-6e93dd900106-kube-api-access-gd5rr\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.618543 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.618412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.618630 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:49:05.618590    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-serving-cert: secret "maas-api-e2e-shared-b-bc6fa6-serving-cert" not found
Jul 15 13:49:05.618677 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:49:05.618665    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls podName:d108eaee-f5f1-4bcb-86e7-6e93dd900106 nodeName:}" failed. No retries permitted until 2026-07-15 13:49:06.118643553 +0000 UTC m=+2555.067661002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls") pod "maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" (UID: "d108eaee-f5f1-4bcb-86e7-6e93dd900106") : secret "maas-api-e2e-shared-b-bc6fa6-serving-cert" not found
Jul 15 13:49:05.619182 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.619160    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d108eaee-f5f1-4bcb-86e7-6e93dd900106-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:05.628113 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:05.628082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd5rr\" (UniqueName: \"kubernetes.io/projected/d108eaee-f5f1-4bcb-86e7-6e93dd900106-kube-api-access-gd5rr\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:06.124525 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:06.124486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:06.126887 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:06.126868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:06.336740 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:06.336706    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:06.480897 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:06.480866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"]
Jul 15 13:49:06.482750 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:49:06.482724    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd108eaee_f5f1_4bcb_86e7_6e93dd900106.slice/crio-da601de5db605ca0dd8ea2cbfec474eb5d3d9e32d4b25725b3de27bff02b3ece WatchSource:0}: Error finding container da601de5db605ca0dd8ea2cbfec474eb5d3d9e32d4b25725b3de27bff02b3ece: Status 404 returned error can't find the container with id da601de5db605ca0dd8ea2cbfec474eb5d3d9e32d4b25725b3de27bff02b3ece
Jul 15 13:49:07.279465 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:07.279422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" event={"ID":"d108eaee-f5f1-4bcb-86e7-6e93dd900106","Type":"ContainerStarted","Data":"601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df"}
Jul 15 13:49:07.279667 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:07.279488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" event={"ID":"d108eaee-f5f1-4bcb-86e7-6e93dd900106","Type":"ContainerStarted","Data":"da601de5db605ca0dd8ea2cbfec474eb5d3d9e32d4b25725b3de27bff02b3ece"}
Jul 15 13:49:07.279667 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:07.279608    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:49:07.296062 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:07.295873    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" podStartSLOduration=1.878619512 podStartE2EDuration="2.295850357s" totalImagesPullingTime="417.230845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:49:07.295694495 +0000 UTC m=+2556.244711990" watchObservedRunningTime="2026-07-15 13:49:07.295850357 +0000 UTC m=+2556.244867829"
Jul 15 13:49:13.291182 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:49:13.291150    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:51:31.716177 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:51:31.716107    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:51:31.718626 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:51:31.718605    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:51:31.725433 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:51:31.725409    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:51:31.727251 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:51:31.727229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:51:31.727800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:51:31.727783    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:51:31.736304 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:51:31.736264    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:55:33.637801 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.637766    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"]
Jul 15 13:55:33.641346 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.641329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:33.643983 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.643952    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:55:33.649912 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.649814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"]
Jul 15 13:55:33.682826 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.682788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67f1929-9f02-4702-84f3-1661cbe2be53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl\" (UID: \"e67f1929-9f02-4702-84f3-1661cbe2be53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:33.783938 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.783899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67f1929-9f02-4702-84f3-1661cbe2be53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl\" (UID: \"e67f1929-9f02-4702-84f3-1661cbe2be53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:33.784572 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.784550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67f1929-9f02-4702-84f3-1661cbe2be53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl\" (UID: \"e67f1929-9f02-4702-84f3-1661cbe2be53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:33.954552 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:33.954521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:34.091105 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:34.091068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"]
Jul 15 13:55:34.092669 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:55:34.092641    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67f1929_9f02_4702_84f3_1661cbe2be53.slice/crio-73ae67f85039390e75d41278e3c611f46b89a71029ce182605ed4c1202977319 WatchSource:0}: Error finding container 73ae67f85039390e75d41278e3c611f46b89a71029ce182605ed4c1202977319: Status 404 returned error can't find the container with id 73ae67f85039390e75d41278e3c611f46b89a71029ce182605ed4c1202977319
Jul 15 13:55:34.413793 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:34.413756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl" event={"ID":"e67f1929-9f02-4702-84f3-1661cbe2be53","Type":"ContainerStarted","Data":"af7222084821917d62ad30922973c4b53aab9d1a78052f44bd53de40d11fb50c"}
Jul 15 13:55:34.413966 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:34.413823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl" event={"ID":"e67f1929-9f02-4702-84f3-1661cbe2be53","Type":"ContainerStarted","Data":"73ae67f85039390e75d41278e3c611f46b89a71029ce182605ed4c1202977319"}
Jul 15 13:55:34.430643 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:34.430591    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl" podStartSLOduration=1.430573505 podStartE2EDuration="1.430573505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:55:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:55:34.429186484 +0000 UTC m=+2943.378203956" watchObservedRunningTime="2026-07-15 13:55:34.430573505 +0000 UTC m=+2943.379590975"
Jul 15 13:55:35.421814 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:35.421775    2561 generic.go:356] "Generic (PLEG): container finished" podID="e67f1929-9f02-4702-84f3-1661cbe2be53" containerID="af7222084821917d62ad30922973c4b53aab9d1a78052f44bd53de40d11fb50c" exitCode=0
Jul 15 13:55:35.422299 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:35.421862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl" event={"ID":"e67f1929-9f02-4702-84f3-1661cbe2be53","Type":"ContainerDied","Data":"af7222084821917d62ad30922973c4b53aab9d1a78052f44bd53de40d11fb50c"}
Jul 15 13:55:36.563974 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:36.563941    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:36.608639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:36.608605    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67f1929-9f02-4702-84f3-1661cbe2be53-maas-api-service-ca\") pod \"e67f1929-9f02-4702-84f3-1661cbe2be53\" (UID: \"e67f1929-9f02-4702-84f3-1661cbe2be53\") "
Jul 15 13:55:36.608951 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:36.608926    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67f1929-9f02-4702-84f3-1661cbe2be53-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e67f1929-9f02-4702-84f3-1661cbe2be53" (UID: "e67f1929-9f02-4702-84f3-1661cbe2be53"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:55:36.709315 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:36.709198    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67f1929-9f02-4702-84f3-1661cbe2be53-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:55:37.434506 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:37.434461    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl" event={"ID":"e67f1929-9f02-4702-84f3-1661cbe2be53","Type":"ContainerDied","Data":"73ae67f85039390e75d41278e3c611f46b89a71029ce182605ed4c1202977319"}
Jul 15 13:55:37.434506 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:37.434497    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl"
Jul 15 13:55:37.434708 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:37.434524    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73ae67f85039390e75d41278e3c611f46b89a71029ce182605ed4c1202977319"
Jul 15 13:55:44.236294 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.236232    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"]
Jul 15 13:55:44.236895 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.236503    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz" podUID="ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" containerName="maas-api" containerID="cri-o://4b9ebe2c6637ee2fa8ac5584df639b5ff0804b8db237f3041972edcde4dca833" gracePeriod=30
Jul 15 13:55:44.474238 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.474204    2561 generic.go:356] "Generic (PLEG): container finished" podID="ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" containerID="4b9ebe2c6637ee2fa8ac5584df639b5ff0804b8db237f3041972edcde4dca833" exitCode=0
Jul 15 13:55:44.474375 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.474270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz" event={"ID":"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582","Type":"ContainerDied","Data":"4b9ebe2c6637ee2fa8ac5584df639b5ff0804b8db237f3041972edcde4dca833"}
Jul 15 13:55:44.491730 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.491671    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:55:44.574259 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.574220    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwq26\" (UniqueName: \"kubernetes.io/projected/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-kube-api-access-dwq26\") pod \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") "
Jul 15 13:55:44.574473 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.574346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-openshift-service-ca\") pod \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") "
Jul 15 13:55:44.574473 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.574371    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-maas-api-tls\") pod \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\" (UID: \"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582\") "
Jul 15 13:55:44.574768 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.574739    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" (UID: "ba6c32aa-dfb9-456a-a8f6-ba8579a7e582"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:55:44.576442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.576409    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" (UID: "ba6c32aa-dfb9-456a-a8f6-ba8579a7e582"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:55:44.576543 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.576420    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-kube-api-access-dwq26" (OuterVolumeSpecName: "kube-api-access-dwq26") pod "ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" (UID: "ba6c32aa-dfb9-456a-a8f6-ba8579a7e582"). InnerVolumeSpecName "kube-api-access-dwq26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:55:44.675322 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.675251    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:55:44.675322 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.675318    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:55:44.675519 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:44.675330    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwq26\" (UniqueName: \"kubernetes.io/projected/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582-kube-api-access-dwq26\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:55:45.481605 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:45.481572    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"
Jul 15 13:55:45.481605 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:45.481591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz" event={"ID":"ba6c32aa-dfb9-456a-a8f6-ba8579a7e582","Type":"ContainerDied","Data":"fb5cea9c89e463698029bb3aee6c89d00a10aadb2bf078adab28a84586e9feb4"}
Jul 15 13:55:45.482052 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:45.481653    2561 scope.go:117] "RemoveContainer" containerID="4b9ebe2c6637ee2fa8ac5584df639b5ff0804b8db237f3041972edcde4dca833"
Jul 15 13:55:45.503598 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:45.503567    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"]
Jul 15 13:55:45.506992 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:45.506965    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7abf62-659b5dd6d4-7tjbz"]
Jul 15 13:55:45.585502 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:45.585468    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" path="/var/lib/kubelet/pods/ba6c32aa-dfb9-456a-a8f6-ba8579a7e582/volumes"
Jul 15 13:55:59.819522 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819485    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"]
Jul 15 13:55:59.819904 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819831    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67f1929-9f02-4702-84f3-1661cbe2be53" containerName="revoke-keys"
Jul 15 13:55:59.819904 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819842    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67f1929-9f02-4702-84f3-1661cbe2be53" containerName="revoke-keys"
Jul 15 13:55:59.819904 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819851    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" containerName="maas-api"
Jul 15 13:55:59.819904 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819856    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" containerName="maas-api"
Jul 15 13:55:59.820037 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819924    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67f1929-9f02-4702-84f3-1661cbe2be53" containerName="revoke-keys"
Jul 15 13:55:59.820037 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.819936    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6c32aa-dfb9-456a-a8f6-ba8579a7e582" containerName="maas-api"
Jul 15 13:55:59.824394 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.824371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:55:59.827157 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.827131    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6nkx\""
Jul 15 13:55:59.832770 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.832681    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"]
Jul 15 13:55:59.904341 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:55:59.904308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6263e61a-a9a6-47fb-9154-2b809daa742b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7\" (UID: \"6263e61a-a9a6-47fb-9154-2b809daa742b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:56:00.005687 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.005644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6263e61a-a9a6-47fb-9154-2b809daa742b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7\" (UID: \"6263e61a-a9a6-47fb-9154-2b809daa742b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:56:00.006335 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.006312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6263e61a-a9a6-47fb-9154-2b809daa742b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7\" (UID: \"6263e61a-a9a6-47fb-9154-2b809daa742b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:56:00.136175 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.136064    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:56:00.280373 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.280339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"]
Jul 15 13:56:00.281147 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:56:00.281117    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6263e61a_a9a6_47fb_9154_2b809daa742b.slice/crio-413498ce7c8bb6724969f5e8d7d1ae444a6797d7f2a67d0db779ac1f93c7bb31 WatchSource:0}: Error finding container 413498ce7c8bb6724969f5e8d7d1ae444a6797d7f2a67d0db779ac1f93c7bb31: Status 404 returned error can't find the container with id 413498ce7c8bb6724969f5e8d7d1ae444a6797d7f2a67d0db779ac1f93c7bb31
Jul 15 13:56:00.563496 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.563458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7" event={"ID":"6263e61a-a9a6-47fb-9154-2b809daa742b","Type":"ContainerStarted","Data":"16d93060055ef093ab21d77756eb4d1b3ee319dd1a5832e603dcb75177592179"}
Jul 15 13:56:00.563664 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.563515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7" event={"ID":"6263e61a-a9a6-47fb-9154-2b809daa742b","Type":"ContainerStarted","Data":"413498ce7c8bb6724969f5e8d7d1ae444a6797d7f2a67d0db779ac1f93c7bb31"}
Jul 15 13:56:00.581550 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:00.581504    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7" podStartSLOduration=1.581487939 podStartE2EDuration="1.581487939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:56:00.578560899 +0000 UTC m=+2969.527578370" watchObservedRunningTime="2026-07-15 13:56:00.581487939 +0000 UTC m=+2969.530505409"
Jul 15 13:56:01.570298 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:01.570240    2561 generic.go:356] "Generic (PLEG): container finished" podID="6263e61a-a9a6-47fb-9154-2b809daa742b" containerID="16d93060055ef093ab21d77756eb4d1b3ee319dd1a5832e603dcb75177592179" exitCode=0
Jul 15 13:56:01.570679 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:01.570325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7" event={"ID":"6263e61a-a9a6-47fb-9154-2b809daa742b","Type":"ContainerDied","Data":"16d93060055ef093ab21d77756eb4d1b3ee319dd1a5832e603dcb75177592179"}
Jul 15 13:56:02.713943 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:02.713915    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:56:02.833732 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:02.833631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6263e61a-a9a6-47fb-9154-2b809daa742b-maas-api-service-ca\") pod \"6263e61a-a9a6-47fb-9154-2b809daa742b\" (UID: \"6263e61a-a9a6-47fb-9154-2b809daa742b\") "
Jul 15 13:56:02.834048 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:02.834014    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6263e61a-a9a6-47fb-9154-2b809daa742b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6263e61a-a9a6-47fb-9154-2b809daa742b" (UID: "6263e61a-a9a6-47fb-9154-2b809daa742b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:56:02.934435 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:02.934399    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6263e61a-a9a6-47fb-9154-2b809daa742b-maas-api-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:56:03.583839 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:03.583807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7"
Jul 15 13:56:03.584639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:03.584610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7" event={"ID":"6263e61a-a9a6-47fb-9154-2b809daa742b","Type":"ContainerDied","Data":"413498ce7c8bb6724969f5e8d7d1ae444a6797d7f2a67d0db779ac1f93c7bb31"}
Jul 15 13:56:03.584764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:03.584662    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="413498ce7c8bb6724969f5e8d7d1ae444a6797d7f2a67d0db779ac1f93c7bb31"
Jul 15 13:56:10.361130 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.361094    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"]
Jul 15 13:56:10.361579 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.361399    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" podUID="d108eaee-f5f1-4bcb-86e7-6e93dd900106" containerName="maas-api" containerID="cri-o://601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df" gracePeriod=30
Jul 15 13:56:10.613508 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.613444    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:56:10.621267 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.621237    2561 generic.go:356] "Generic (PLEG): container finished" podID="d108eaee-f5f1-4bcb-86e7-6e93dd900106" containerID="601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df" exitCode=0
Jul 15 13:56:10.621419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.621294    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"
Jul 15 13:56:10.621419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.621308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" event={"ID":"d108eaee-f5f1-4bcb-86e7-6e93dd900106","Type":"ContainerDied","Data":"601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df"}
Jul 15 13:56:10.621419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.621363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp" event={"ID":"d108eaee-f5f1-4bcb-86e7-6e93dd900106","Type":"ContainerDied","Data":"da601de5db605ca0dd8ea2cbfec474eb5d3d9e32d4b25725b3de27bff02b3ece"}
Jul 15 13:56:10.621419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.621391    2561 scope.go:117] "RemoveContainer" containerID="601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df"
Jul 15 13:56:10.631147 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.631112    2561 scope.go:117] "RemoveContainer" containerID="601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df"
Jul 15 13:56:10.631551 ip-10-0-143-224 kubenswrapper[2561]: E0715 13:56:10.631522    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df\": container with ID starting with 601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df not found: ID does not exist" containerID="601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df"
Jul 15 13:56:10.631663 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.631559    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df"} err="failed to get container status \"601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df\": rpc error: code = NotFound desc = could not find container \"601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df\": container with ID starting with 601cbab568e84b547c018fbb976f7aa70e69dd9566a40330b1dd8e54dc11f7df not found: ID does not exist"
Jul 15 13:56:10.803182 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.803139    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls\") pod \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") "
Jul 15 13:56:10.803411 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.803190    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d108eaee-f5f1-4bcb-86e7-6e93dd900106-openshift-service-ca\") pod \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") "
Jul 15 13:56:10.803411 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.803220    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd5rr\" (UniqueName: \"kubernetes.io/projected/d108eaee-f5f1-4bcb-86e7-6e93dd900106-kube-api-access-gd5rr\") pod \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\" (UID: \"d108eaee-f5f1-4bcb-86e7-6e93dd900106\") "
Jul 15 13:56:10.803599 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.803572    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d108eaee-f5f1-4bcb-86e7-6e93dd900106-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d108eaee-f5f1-4bcb-86e7-6e93dd900106" (UID: "d108eaee-f5f1-4bcb-86e7-6e93dd900106"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:56:10.805487 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.805459    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d108eaee-f5f1-4bcb-86e7-6e93dd900106-kube-api-access-gd5rr" (OuterVolumeSpecName: "kube-api-access-gd5rr") pod "d108eaee-f5f1-4bcb-86e7-6e93dd900106" (UID: "d108eaee-f5f1-4bcb-86e7-6e93dd900106"). InnerVolumeSpecName "kube-api-access-gd5rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:56:10.805531 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.805481    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d108eaee-f5f1-4bcb-86e7-6e93dd900106" (UID: "d108eaee-f5f1-4bcb-86e7-6e93dd900106"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:56:10.904764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.904674    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d108eaee-f5f1-4bcb-86e7-6e93dd900106-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:56:10.904764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.904714    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d108eaee-f5f1-4bcb-86e7-6e93dd900106-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:56:10.904764 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.904731    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd5rr\" (UniqueName: \"kubernetes.io/projected/d108eaee-f5f1-4bcb-86e7-6e93dd900106-kube-api-access-gd5rr\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Jul 15 13:56:10.944627 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.944594    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"]
Jul 15 13:56:10.948900 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:10.948877    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc6fa6-6459964847-s2dfp"]
Jul 15 13:56:11.586419 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:11.586388    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d108eaee-f5f1-4bcb-86e7-6e93dd900106" path="/var/lib/kubelet/pods/d108eaee-f5f1-4bcb-86e7-6e93dd900106/volumes"
Jul 15 13:56:31.753063 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:31.753030    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:56:31.755328 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:31.755303    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:56:31.763396 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:31.763372    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:56:31.763831 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:31.763813    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:56:31.765912 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:31.765894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:56:31.773679 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:31.773659    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdmmc_6c4dd699-0297-458a-bc7a-1f9d38048e55/ovn-acl-logging/0.log"
Jul 15 13:56:32.254069 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:32.254035    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c84f7bcc-4tz9n_d0874dca-7a30-49b3-a27a-c16a86942c37/manager/0.log"
Jul 15 13:56:32.744576 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:32.744550    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869c48857d-gbbhs_e8c64e12-47a2-405d-b887-c0140cd5d4cf/manager/0.log"
Jul 15 13:56:32.751442 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:32.751422    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869c48857d-gbbhs_e8c64e12-47a2-405d-b887-c0140cd5d4cf/copy-manifests/0.log"
Jul 15 13:56:33.251391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:33.251357    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b4f6d47b-pmpx2_97ad30b3-0703-4b66-ac79-7916bc0d248c/maas-api/0.log"
Jul 15 13:56:33.834082 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:33.834042    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-23e666-nsrv2_5e4ebde5-24a0-4e3c-b977-03a6e78f6a17/revoke-keys/0.log"
Jul 15 13:56:33.953555 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:33.953520    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-929ef6-hdjd2_329c9aea-5ced-4eac-9f11-586b8427b3a6/revoke-keys/0.log"
Jul 15 13:56:34.189676 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:34.189645    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-486f14-ppjh2_676102b3-7424-4553-a09e-f54e26615264/revoke-keys/0.log"
Jul 15 13:56:34.304162 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:34.304130    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-a5d1bc-4j6bd_ad08b1b1-60a7-4b5b-886e-6c5180dfc00c/revoke-keys/0.log"
Jul 15 13:56:34.644612 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:34.644540    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-e86098b2-xtqsf_7d290901-37a5-4a43-80c7-f3c68f81c0c7/revoke-keys/0.log"
Jul 15 13:56:34.761394 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:34.761368    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-7abf62-4kxdl_e67f1929-9f02-4702-84f3-1661cbe2be53/revoke-keys/0.log"
Jul 15 13:56:34.878222 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:34.878191    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-bc6fa6-fnxj7_6263e61a-a9a6-47fb-9154-2b809daa742b/revoke-keys/0.log"
Jul 15 13:56:34.997247 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:34.997220    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8zsvw_b1c0ab93-82b3-49cd-ba9f-86724cb79259/postgres/0.log"
Jul 15 13:56:35.789148 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:35.789118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66_00b636ad-c615-4cb2-a2b5-f7b50b542834/extract/0.log"
Jul 15 13:56:35.796160 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:35.796137    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66_00b636ad-c615-4cb2-a2b5-f7b50b542834/util/0.log"
Jul 15 13:56:35.801834 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:35.801811    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66_00b636ad-c615-4cb2-a2b5-f7b50b542834/pull/0.log"
Jul 15 13:56:35.912527 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:35.912495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz_54222270-f846-4891-bd38-286842c332f7/extract/0.log"
Jul 15 13:56:35.919454 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:35.919422    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz_54222270-f846-4891-bd38-286842c332f7/util/0.log"
Jul 15 13:56:35.925719 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:35.925701    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz_54222270-f846-4891-bd38-286842c332f7/pull/0.log"
Jul 15 13:56:36.040391 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:36.040313    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g_c02b0bb3-3518-4202-a1fd-a33c1820421b/util/0.log"
Jul 15 13:56:36.047190 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:36.047164    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g_c02b0bb3-3518-4202-a1fd-a33c1820421b/pull/0.log"
Jul 15 13:56:36.053357 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:36.053339    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g_c02b0bb3-3518-4202-a1fd-a33c1820421b/extract/0.log"
Jul 15 13:56:36.167741 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:36.167712    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs_f0bb0cab-4907-4326-8be9-3c33477b27b6/util/0.log"
Jul 15 13:56:36.174018 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:36.173994    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs_f0bb0cab-4907-4326-8be9-3c33477b27b6/pull/0.log"
Jul 15 13:56:36.179667 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:36.179648    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs_f0bb0cab-4907-4326-8be9-3c33477b27b6/extract/0.log"
Jul 15 13:56:37.671692 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:37.671651    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5mw5_98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81/discovery/0.log"
Jul 15 13:56:38.259686 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:38.259655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pgrlr_50b3828a-7acf-4200-9fba-01fd34635d5d/payload-processing/0.log"
Jul 15 13:56:38.847736 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:38.847706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4b8mh_edd867b3-7a93-43bc-8b97-8bf0a3aea381/main/0.log"
Jul 15 13:56:39.080608 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:39.080580    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7lq2r_c26f63e1-51fa-4bfc-a342-791c80866db8/main/0.log"
Jul 15 13:56:47.939498 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:47.939469    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rqjmp_aea8d8b2-fea6-4098-ba33-99a22b7022a4/global-pull-secret-syncer/0.log"
Jul 15 13:56:48.055467 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:48.055441    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lqb5j_52a78dd4-98bf-4c8b-b4cb-50e16b079019/konnectivity-agent/0.log"
Jul 15 13:56:48.131652 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:48.131623    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-224.ec2.internal_bf6b0844b00827ab6eeff6cc6879a70c/haproxy/0.log"
Jul 15 13:56:52.010634 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.010606    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66_00b636ad-c615-4cb2-a2b5-f7b50b542834/extract/0.log"
Jul 15 13:56:52.032484 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.032459    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66_00b636ad-c615-4cb2-a2b5-f7b50b542834/util/0.log"
Jul 15 13:56:52.053886 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.053865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922w66_00b636ad-c615-4cb2-a2b5-f7b50b542834/pull/0.log"
Jul 15 13:56:52.089714 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.089692    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz_54222270-f846-4891-bd38-286842c332f7/extract/0.log"
Jul 15 13:56:52.110613 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.110587    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz_54222270-f846-4891-bd38-286842c332f7/util/0.log"
Jul 15 13:56:52.134901 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.134854    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nbxlz_54222270-f846-4891-bd38-286842c332f7/pull/0.log"
Jul 15 13:56:52.168030 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.167983    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g_c02b0bb3-3518-4202-a1fd-a33c1820421b/extract/0.log"
Jul 15 13:56:52.203833 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.203804    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g_c02b0bb3-3518-4202-a1fd-a33c1820421b/util/0.log"
Jul 15 13:56:52.225620 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.225598    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r8r5g_c02b0bb3-3518-4202-a1fd-a33c1820421b/pull/0.log"
Jul 15 13:56:52.253014 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.252991    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs_f0bb0cab-4907-4326-8be9-3c33477b27b6/extract/0.log"
Jul 15 13:56:52.289207 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.289128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs_f0bb0cab-4907-4326-8be9-3c33477b27b6/util/0.log"
Jul 15 13:56:52.309428 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:52.309395    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djxrs_f0bb0cab-4907-4326-8be9-3c33477b27b6/pull/0.log"
Jul 15 13:56:54.901622 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:54.901588    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/1.log"
Jul 15 13:56:54.975659 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:54.975627    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wff76_6619589a-6871-41f1-a3bb-278fd395c762/cluster-monitoring-operator/0.log"
Jul 15 13:56:55.108517 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:55.108486    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-d5lcq_9a09a6ff-4048-4927-bf2c-e9e8f35a0424/monitoring-plugin/0.log"
Jul 15 13:56:55.143750 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:55.143721    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwn5q_039e496d-7b5b-42e2-9a11-9fbb9c5db1be/node-exporter/0.log"
Jul 15 13:56:55.167181 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:55.167107    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwn5q_039e496d-7b5b-42e2-9a11-9fbb9c5db1be/kube-rbac-proxy/0.log"
Jul 15 13:56:55.193059 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:55.193034    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwn5q_039e496d-7b5b-42e2-9a11-9fbb9c5db1be/init-textfile/0.log"
Jul 15 13:56:55.788931 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:55.788896    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-slm8h_8aa924a8-2b91-49b8-977d-e74a08bab0e7/prometheus-operator/0.log"
Jul 15 13:56:55.833881 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:55.833812    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-slm8h_8aa924a8-2b91-49b8-977d-e74a08bab0e7/kube-rbac-proxy/0.log"
Jul 15 13:56:57.473000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:57.472967    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-q94x6_4bb1ea25-0aaa-41c0-9771-6674e12397bb/networking-console-plugin/0.log"
Jul 15 13:56:58.091987 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.091957    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/1.log"
Jul 15 13:56:58.097310 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.097290    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kh7k7_998dabda-e2bf-479e-96d2-c64054271cd4/console-operator/2.log"
Jul 15 13:56:58.303951 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.303907    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"]
Jul 15 13:56:58.304448 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.304430    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6263e61a-a9a6-47fb-9154-2b809daa742b" containerName="revoke-keys"
Jul 15 13:56:58.304448 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.304450    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6263e61a-a9a6-47fb-9154-2b809daa742b" containerName="revoke-keys"
Jul 15 13:56:58.304610 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.304460    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d108eaee-f5f1-4bcb-86e7-6e93dd900106" containerName="maas-api"
Jul 15 13:56:58.304610 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.304466    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d108eaee-f5f1-4bcb-86e7-6e93dd900106" containerName="maas-api"
Jul 15 13:56:58.304610 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.304524    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d108eaee-f5f1-4bcb-86e7-6e93dd900106" containerName="maas-api"
Jul 15 13:56:58.304610 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.304534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6263e61a-a9a6-47fb-9154-2b809daa742b" containerName="revoke-keys"
Jul 15 13:56:58.307618 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.307598    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.310138 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.310114    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvq2f\"/\"openshift-service-ca.crt\""
Jul 15 13:56:58.310288 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.310178    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvq2f\"/\"kube-root-ca.crt\""
Jul 15 13:56:58.310288 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.310236    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mvq2f\"/\"default-dockercfg-wct6h\""
Jul 15 13:56:58.316053 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.316030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"]
Jul 15 13:56:58.397453 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.397366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-sys\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.397453 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.397431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-lib-modules\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.397675 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.397468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qkz\" (UniqueName: \"kubernetes.io/projected/b5349f2d-614a-4dcc-9db9-573f2f391256-kube-api-access-x2qkz\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.397675 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.397492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-podres\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.397675 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.397553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-proc\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.498543 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-proc\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-sys\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-proc\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-lib-modules\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qkz\" (UniqueName: \"kubernetes.io/projected/b5349f2d-614a-4dcc-9db9-573f2f391256-kube-api-access-x2qkz\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-sys\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-podres\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-lib-modules\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.499000 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.498860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5349f2d-614a-4dcc-9db9-573f2f391256-podres\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.505952 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.505917    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qkz\" (UniqueName: \"kubernetes.io/projected/b5349f2d-614a-4dcc-9db9-573f2f391256-kube-api-access-x2qkz\") pod \"perf-node-gather-daemonset-mvhp9\" (UID: \"b5349f2d-614a-4dcc-9db9-573f2f391256\") " pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.618008 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.617976    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.721680 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.721553    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-xnbkl_b122ec39-2a64-43a4-8a44-946ce0df4050/download-server/0.log"
Jul 15 13:56:58.752194 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.752170    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"]
Jul 15 13:56:58.753885 ip-10-0-143-224 kubenswrapper[2561]: W0715 13:56:58.753856    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb5349f2d_614a_4dcc_9db9_573f2f391256.slice/crio-0b7c095375ce0e77289e56630f543043bd970accee99a360181b71f9423ca198 WatchSource:0}: Error finding container 0b7c095375ce0e77289e56630f543043bd970accee99a360181b71f9423ca198: Status 404 returned error can't find the container with id 0b7c095375ce0e77289e56630f543043bd970accee99a360181b71f9423ca198
Jul 15 13:56:58.879363 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.879322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9" event={"ID":"b5349f2d-614a-4dcc-9db9-573f2f391256","Type":"ContainerStarted","Data":"ee26aa9bef73fe30cee520a06c0914487ae10e438457224b22009db7f0f12404"}
Jul 15 13:56:58.879544 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.879378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9" event={"ID":"b5349f2d-614a-4dcc-9db9-573f2f391256","Type":"ContainerStarted","Data":"0b7c095375ce0e77289e56630f543043bd970accee99a360181b71f9423ca198"}
Jul 15 13:56:58.879544 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.879408    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:56:58.896364 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:56:58.896309    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9" podStartSLOduration=0.896292658 podStartE2EDuration="896.292658ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:56:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:56:58.895059159 +0000 UTC m=+3027.844076643" watchObservedRunningTime="2026-07-15 13:56:58.896292658 +0000 UTC m=+3027.845310178"
Jul 15 13:57:00.409225 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:00.409184    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lmkbx_9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1/dns/0.log"
Jul 15 13:57:00.433608 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:00.433578    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lmkbx_9d31f6b8-0ea5-4d10-9aef-b9f3fda4bce1/kube-rbac-proxy/0.log"
Jul 15 13:57:00.577433 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:00.577399    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8567_29d473db-3c07-45ba-b602-7af6780e7e88/dns-node-resolver/0.log"
Jul 15 13:57:01.148225 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:01.148194    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7ccdf4bf97-g5wd7_6d1222dc-5056-43b0-80a6-3827ac08d6e3/registry/0.log"
Jul 15 13:57:01.168221 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:01.168197    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ggpgm_c08f3d1c-a2d6-4668-91bd-7072d254a978/node-ca/0.log"
Jul 15 13:57:02.258483 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:02.258452    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5mw5_98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81/discovery/0.log"
Jul 15 13:57:02.425152 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:02.425122    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pgrlr_50b3828a-7acf-4200-9fba-01fd34635d5d/payload-processing/0.log"
Jul 15 13:57:03.216614 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:03.216583    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smj5h_ec15faff-43dc-4453-b2e5-025a8fa7fd50/serve-healthcheck-canary/0.log"
Jul 15 13:57:03.678074 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:03.678039    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-bm7rt_fbce2ac0-78c6-4dc2-bb4e-59535131e713/insights-operator/0.log"
Jul 15 13:57:03.678562 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:03.678294    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-bm7rt_fbce2ac0-78c6-4dc2-bb4e-59535131e713/insights-operator/1.log"
Jul 15 13:57:03.766338 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:03.766299    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-slg62_45fff1a8-86c1-4ba7-b982-71a86a255235/kube-rbac-proxy/0.log"
Jul 15 13:57:03.786372 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:03.786348    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-slg62_45fff1a8-86c1-4ba7-b982-71a86a255235/exporter/0.log"
Jul 15 13:57:03.807881 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:03.807852    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-slg62_45fff1a8-86c1-4ba7-b982-71a86a255235/extractor/0.log"
Jul 15 13:57:04.895809 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:04.895784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mvq2f/perf-node-gather-daemonset-mvhp9"
Jul 15 13:57:06.205893 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:06.205862    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c84f7bcc-4tz9n_d0874dca-7a30-49b3-a27a-c16a86942c37/manager/0.log"
Jul 15 13:57:06.367861 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:06.367827    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869c48857d-gbbhs_e8c64e12-47a2-405d-b887-c0140cd5d4cf/manager/0.log"
Jul 15 13:57:06.389868 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:06.389842    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869c48857d-gbbhs_e8c64e12-47a2-405d-b887-c0140cd5d4cf/copy-manifests/0.log"
Jul 15 13:57:07.934294 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:07.934253    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8ddc6f8f9-p8gmb_63253f9e-d65e-44f4-b59a-70b033d85ccb/manager/0.log"
Jul 15 13:57:08.574535 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:08.574500    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5mw5_98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81/discovery/0.log"
Jul 15 13:57:08.684602 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:08.684571    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pgrlr_50b3828a-7acf-4200-9fba-01fd34635d5d/payload-processing/0.log"
Jul 15 13:57:09.979260 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:09.979224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5mw5_98dcc4f7-110c-42e5-ab2d-ad2f6bf2ad81/discovery/0.log"
Jul 15 13:57:10.098500 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:10.098413    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pgrlr_50b3828a-7acf-4200-9fba-01fd34635d5d/payload-processing/0.log"
Jul 15 13:57:13.005518 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:13.005487    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sj6nt_df9972db-aee6-49cb-ba54-952ec804d30a/migrator/0.log"
Jul 15 13:57:13.025639 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:13.025618    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sj6nt_df9972db-aee6-49cb-ba54-952ec804d30a/graceful-termination/0.log"
Jul 15 13:57:14.431751 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.431720    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/kube-multus-additional-cni-plugins/0.log"
Jul 15 13:57:14.452013 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.451991    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/egress-router-binary-copy/0.log"
Jul 15 13:57:14.471344 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.471321    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/cni-plugins/0.log"
Jul 15 13:57:14.490088 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.490059    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/bond-cni-plugin/0.log"
Jul 15 13:57:14.509916 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.509894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/routeoverride-cni/0.log"
Jul 15 13:57:14.530761 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.530734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/whereabouts-cni-bincopy/0.log"
Jul 15 13:57:14.556800 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.556773    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnh2g_f88d2deb-323b-4573-8132-689d02eb00e8/whereabouts-cni/0.log"
Jul 15 13:57:14.880553 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.880471    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mnmrf_55e71a5a-1ae0-431f-8c4f-6222fb9d05ee/kube-multus/0.log"
Jul 15 13:57:14.962694 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.962660    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2fj7r_f02e7e8e-7628-4291-bcc6-203da9da2216/network-metrics-daemon/0.log"
Jul 15 13:57:14.981290 ip-10-0-143-224 kubenswrapper[2561]: I0715 13:57:14.981246    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2fj7r_f02e7e8e-7628-4291-bcc6-203da9da2216/kube-rbac-proxy/0.log"