Jul 21 01:51:47.694430 ip-10-0-141-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 01:51:47.694442 ip-10-0-141-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 01:51:47.694449 ip-10-0-141-1 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 01:51:47.694683 ip-10-0-141-1 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 01:51:57.744850 ip-10-0-141-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 01:51:57.744866 ip-10-0-141-1 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 928a37bc35c4487a80a57371ae47a37c --
Jul 21 01:53:52.131526 ip-10-0-141-1 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.605838    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609372    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609386    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609392    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609397    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609400    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609403    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609406    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:53:52.651013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609408    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609411    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609414    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609416    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609419    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609421    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609424    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609434    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609437    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609440    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609443    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609445    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609448    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609450    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609453    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609456    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609458    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609461    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609464    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609467    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:53:52.653172 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609470    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609472    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609475    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609477    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609480    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609483    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609485    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609488    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609490    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609493    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609495    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609498    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609502    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609505    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609509    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609512    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609514    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609517    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609520    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609523    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:53:52.653776 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609526    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609529    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609531    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609534    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609537    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609539    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609542    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609544    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609547    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609550    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609553    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609556    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609558    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609561    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609564    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609567    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609570    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609572    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609575    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609577    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:53:52.654502 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609580    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609582    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609585    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609587    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609590    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609592    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609595    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609597    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609600    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609602    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609605    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609608    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609612    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609615    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609619    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609623    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609626    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609628    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609631    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609634    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:53:52.655074 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609637    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609640    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609642    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609645    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609648    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609650    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609653    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609655    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609658    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609660    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609662    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.609665    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610419    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610427    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610430    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610434    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610436    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610440    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610442    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:53:52.655784 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610445    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610448    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610451    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610453    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610456    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610459    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610462    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610472    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610474    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610477    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610481    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610486    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610490    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610493    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610496    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610499    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610502    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610504    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610507    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610510    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:53:52.656366 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610513    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610515    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610518    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610522    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610525    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610528    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610531    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610534    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610537    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610540    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610543    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610546    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610548    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610551    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610554    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610557    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610560    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610562    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610565    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610568    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:53:52.657156 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610576    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610579    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610582    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610584    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610587    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610590    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610593    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610597    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610599    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610602    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610604    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610607    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610609    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610612    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610614    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610617    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610619    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610621    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610624    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:53:52.657732 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610626    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610629    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610631    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610635    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610637    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610639    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610642    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610645    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610647    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610650    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610653    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610656    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610659    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610661    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610669    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610672    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610674    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610677    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610679    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:53:52.658620 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610681    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610684    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610686    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610689    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610692    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610694    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610696    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610699    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610702    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610704    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610707    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610709    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610712    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.610714    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611149    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611153    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611156    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611159    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611162    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611165    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:53:52.723944 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611168    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:53:52.718792 ip-10-0-141-1 systemd[1]: Started Kubernetes Kubelet.
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611171    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611173    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611176    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611178    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611183    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611186    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611194    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611197    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611200    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611203    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611205    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611207    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611210    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611212    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611216    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611220    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611223    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611225    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611228    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:53:52.724932 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611244    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611247    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611250    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611252    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611255    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611257    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611262    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611264    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611267    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611270    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611272    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611275    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611278    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611280    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611283    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611285    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611289    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611293    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611296    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611298    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:53:52.728022 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611307    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611310    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611312    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611315    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611317    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611320    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611322    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611325    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611327    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611330    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611332    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611335    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611337    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611339    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611342    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611344    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611347    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611349    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611354    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611357    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:53:52.728675 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611360    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611362    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611365    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611370    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611373    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611376    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611380    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611382    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611385    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611389    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611391    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611394    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611396    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611405    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611407    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611410    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611412    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611415    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611417    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:53:52.729529 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611420    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611424    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611427    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611430    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611433    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611436    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611438    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611441    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611444    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611446    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611449    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611452    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611458    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.611461    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611520    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611527    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611537    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611542    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611545    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611549    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 01:53:52.731226 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611553    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611558    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611565    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611568    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611571    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611574    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611577    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611587    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611591    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611594    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611596    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611599    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611606    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611608    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611613    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611616    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611619    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611623    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611625    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611629    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611632    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611635    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611638    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611642    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 01:53:52.731869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611645    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611648    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611653    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611656    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611658    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611661    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611665    2574 flags.go:64] FLAG: --enable-server="true"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611667    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611674    2574 flags.go:64] FLAG: --event-burst="100"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611677    2574 flags.go:64] FLAG: --event-qps="50"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611682    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611685    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611688    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611691    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611694    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611698    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611706    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611709    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611712    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611715    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611718    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611721    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611724    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611727    2574 flags.go:64] FLAG: --feature-gates=""
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611730    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 01:53:52.734159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611733    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611736    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611739    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611742    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611745    2574 flags.go:64] FLAG: --help="false"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611748    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-1.ec2.internal"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611752    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611755    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611758    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611761    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611765    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611767    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611770    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611773    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611776    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611779    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611782    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611786    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611789    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611792    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611795    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611798    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611800    2574 flags.go:64] FLAG: --lock-file=""
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611803    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 01:53:52.735015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611812    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611815    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611820    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611823    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611826    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611829    2574 flags.go:64] FLAG: --logging-format="text"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611832    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611835    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611838    2574 flags.go:64] FLAG: --manifest-url=""
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611841    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611845    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611848    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611852    2574 flags.go:64] FLAG: --max-pods="110"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611854    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611859    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611862    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611865    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611868    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611871    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611874    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611881    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611884    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611887    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 01:53:52.793499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611890    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611892    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611899    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611902    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611905    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611909    2574 flags.go:64] FLAG: --port="10250"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611912    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611920    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a9adbc1d085abd5f"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611924    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611927    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611935    2574 flags.go:64] FLAG: --register-node="true"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611938    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611942    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611945    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611948    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611950    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611954    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611957    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611960    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611962    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611965    2574 flags.go:64] FLAG: --runonce="false"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611968    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611971    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611974    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611978    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 01:53:52.794580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611981    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611984    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611987    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611991    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611993    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611996    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.611999    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612002    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612005    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612010    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612013    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612018    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612021    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612024    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612031    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612033    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612037    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612040    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612048    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612052    2574 flags.go:64] FLAG: --v="2"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612056    2574 flags.go:64] FLAG: --version="false"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612059    2574 flags.go:64] FLAG: --vmodule=""
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612063    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.612066    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612217    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:53:52.800175 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612221    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612224    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612227    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612243    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612246    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612249    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612253    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612257    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612259    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612262    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612265    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612269    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612272    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612275    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612278    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612281    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612285    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612287    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612290    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:53:52.801489 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612293    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612296    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612298    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612301    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612303    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612306    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612308    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612318    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612321    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612323    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612326    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612329    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612331    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612334    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612336    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612339    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612341    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612344    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612346    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612350    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:53:52.802109 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612353    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612355    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612358    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612360    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612363    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612365    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612368    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612370    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612373    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612377    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612380    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612382    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612385    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612387    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612390    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612392    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612395    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612397    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612400    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612402    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:53:52.803173 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612411    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612414    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612416    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612419    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612421    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612423    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612426    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612430    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612433    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612436    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612439    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612443    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612447    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612450    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612452    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612455    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612458    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612460    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612462    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:53:52.803815 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612465    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612468    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612472    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612475    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612477    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612480    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612482    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612485    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612487    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612490    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612492    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612495    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612497    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612500    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612508    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612511    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612513    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612516    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612518    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:53:52.804469 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.612521    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.613101    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.659543    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.659563    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.659579    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.659589    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659652    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659658    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659661    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659664    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659666    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659669    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659672    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659675    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:53:52.805007 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659677    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659680    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659683    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659686    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659689    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659691    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659694    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659697    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659700    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659702    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659705    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659708    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659710    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659714    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659717    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659720    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659722    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659725    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659728    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659730    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:53:52.805612 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659733    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659735    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659740    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659743    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659746    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659749    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659752    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659755    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659757    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659761    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659763    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659766    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659768    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659771    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659773    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659776    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659779    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659782    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659785    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:53:52.807610 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659788    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659790    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659793    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659796    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659798    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659801    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659804    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659807    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659809    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659812    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659814    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659817    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659820    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659822    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659825    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659827    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659832    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659836    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659839    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:53:52.808305 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659841    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659844    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659847    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659850    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659852    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659855    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659858    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659861    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659864    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659867    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659869    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659872    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659875    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659878    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659881    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659883    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659886    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659888    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659891    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659893    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:53:52.809047 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659896    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659898    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659901    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659903    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659906    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659908    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659911    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659913    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659916    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659919    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659923    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659926    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.659929    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.659934    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:53:52.809911 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660057    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660062    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660065    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660068    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660072    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660074    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660077    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660080    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660083    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660086    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660088    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660091    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660095    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660099    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660102    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660105    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660108    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660111    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660114    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:53:52.810557 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660117    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660119    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660122    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660124    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660127    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660129    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660132    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660135    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660137    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660139    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660142    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660144    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660147    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660149    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660153    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660159    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660162    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660165    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660168    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:53:52.811400 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660170    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660173    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660177    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660179    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660183    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660186    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660189    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660192    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660195    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660197    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660200    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660202    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660205    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660208    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660210    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660213    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660215    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660218    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660220    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660223    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:53:52.812142 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660226    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660229    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660247    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660250    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660252    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660255    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660257    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660260    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660264    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660266    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660269    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660272    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660275    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660277    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660280    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660283    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660285    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660288    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660290    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660293    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660296    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:53:52.812730 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660299    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660302    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660304    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660307    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660310    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660312    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660315    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660317    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660320    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660322    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660325    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660327    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660330    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660332    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660335    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660337    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660340    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660342    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660345    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:53:52.813413 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:52.660349    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.660354    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.660483    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.662792    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.664555    2574 server.go:1019] "Starting client certificate rotation"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.664663    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.664693    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.667067    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.670111    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.682001    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.684427    2574 log.go:25] "Validated CRI v1 image API"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.685330    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 01:53:52.813991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.690522    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 875e1a53-2824-43ff-9473-801c8c2f0613:/dev/nvme0n1p3 bf8b3fe4-bcc8-4e1f-af23-bce11f3ad420:/dev/nvme0n1p4]
Jul 21 01:53:52.814346 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.690540    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.696448    2574 manager.go:216] Machine: {Timestamp:2026-07-21 01:53:52.694289749 +0000 UTC m=+0.436096085 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102003 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e3b2d25e33ffb4f9ef07ed94aaae SystemUUID:ec25e3b2-d25e-33ff-b4f9-ef07ed94aaae BootID:928a37bc-35c4-487a-80a5-7371ae47a37c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:a2:f6:c4:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:a2:f6:c4:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:52:aa:a9:40:24 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.696615    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.696718    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.698070    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.698097    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.698853    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.698864    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 01:53:52.814390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.698874    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.699644    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.700932    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704222    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704370    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704950    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704962    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704976    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704988    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.704999    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.705480    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.705536    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.710066    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.710183    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.712583    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.712611    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714279    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714301    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714310    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714317    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714327    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714333    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714341    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714346    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714352    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714358    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714375    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714381    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714431    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.714438    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.717884    2574 server.go:1268] "Started kubelet"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.717943    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.717955    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.718016    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.718687    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.718800    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.718813    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.719767    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 01:53:52.814624 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.742793    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m99c9"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.743198    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.771050    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m99c9"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.771092    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.774268    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-1.ec2.internal.18c42b2ee2b62b89  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-1.ec2.internal,UID:ip-10-0-141-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-1.ec2.internal,},FirstTimestamp:2026-07-21 01:53:52.717638537 +0000 UTC m=+0.459444868,LastTimestamp:2026-07-21 01:53:52.717638537 +0000 UTC m=+0.459444868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-1.ec2.internal,}"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.778930    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.779116    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.779264    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.780692    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.780711    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.780907    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.780989    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.780996    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.781759    2574 factory.go:55] Registering systemd factory
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.781775    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.781971    2574 factory.go:153] Registering CRI-O factory
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.781984    2574 factory.go:223] Registration of the crio container factory successfully
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.782027    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.782046    2574 factory.go:103] Registering Raw factory
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.782055    2574 manager.go:1196] Started watching for new ooms in manager
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.782376    2574 manager.go:349] Starting recovery of all containers
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.788737    2574 manager.go:354] Recovery completed
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.808821    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.810830    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.811970    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.812995    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.813026    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.813040    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.813713    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.813726    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.813732    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.813747    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.815041    2574 policy_none.go:49] "None policy: Start"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.815060    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.815075    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.815736    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:52.815758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.815760    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:52.816705 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.815781    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:52.816705 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.816405    2574 policy_none.go:47] "Start"
Jul 21 01:53:52.880072 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.880052    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:52.887995 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.887980    2574 manager.go:337] "Starting Device Plugin manager"
Jul 21 01:53:52.888082 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.888015    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 01:53:52.888082 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.888026    2574 server.go:87] "Starting device plugin registration server"
Jul 21 01:53:52.888329 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.888301    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 01:53:52.888419 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.888328    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 01:53:52.888476 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.888415    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 01:53:52.888549 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.888505    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 01:53:52.888549 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.888516    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 01:53:52.889134 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.889108    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 01:53:52.889235 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.889171    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:52.989225 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.989184    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:52.990506 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.990486    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:52.990580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.990524    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:52.990580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.990539    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:52.990580 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.990567    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-1.ec2.internal"
Jul 21 01:53:52.997681 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:52.997664    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-1.ec2.internal"
Jul 21 01:53:52.997796 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:52.997689    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-1.ec2.internal\": node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.013810 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.013782    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 01:53:53.015175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.015150    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 01:53:53.015308 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.015201    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 01:53:53.015308 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.015235    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 01:53:53.015308 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.015271    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 01:53:53.020404 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.020387    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:53.057743 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.057714    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.117468 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.117394    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"]
Jul 21 01:53:53.117557 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.117483    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:53.118657 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.118633    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:53.118746 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.118673    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:53.118746 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.118688    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:53.120010 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.119997    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:53.120138 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120121    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.120197 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120171    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:53.120839 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120822    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:53.120839 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120832    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:53.120946 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120852    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:53.120946 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120856    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:53.120946 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120862    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:53.120946 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.120866    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:53.122100 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.122082    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.122174 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.122110    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:53:53.122814 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.122798    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:53:53.122876 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.122825    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:53:53.122876 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.122838    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:53:53.157985 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.157801    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.159168 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.159153    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.164094 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.164079    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.182896 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.182873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b1b50bc9c76b160afe236717f6e8775-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b1b50bc9c76b160afe236717f6e8775\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.183013 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.182902    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b1b50bc9c76b160afe236717f6e8775-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b1b50bc9c76b160afe236717f6e8775\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.183013 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.182923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8164ea24c973945e2299d7670db9fc95-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"8164ea24c973945e2299d7670db9fc95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.259025 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.258989    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.283083 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.283050    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b1b50bc9c76b160afe236717f6e8775-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b1b50bc9c76b160afe236717f6e8775\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.283149 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.283091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b1b50bc9c76b160afe236717f6e8775-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b1b50bc9c76b160afe236717f6e8775\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.283149 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.283109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8164ea24c973945e2299d7670db9fc95-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"8164ea24c973945e2299d7670db9fc95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.283222 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.283161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b1b50bc9c76b160afe236717f6e8775-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b1b50bc9c76b160afe236717f6e8775\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.283222 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.283165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b1b50bc9c76b160afe236717f6e8775-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b1b50bc9c76b160afe236717f6e8775\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.283222 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.283213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8164ea24c973945e2299d7670db9fc95-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"8164ea24c973945e2299d7670db9fc95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.361853 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.361819    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.467899 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.467821    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.468033 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.467823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.468033 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.467828    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.568319 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.568269    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 21 01:53:53.648807 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.648784    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:53.663188 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.663161    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 01:53:53.663659 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.663318    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:53:53.663659 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.663352    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:53:53.663659 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.663393    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:53:53.682300 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.682273    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.705503 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.705471    2574 apiserver.go:52] "Watching apiserver"
Jul 21 01:53:53.706316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.706285    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:53:53.708703 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.708681    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 21 01:53:53.713530 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.713497    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 01:53:53.715467 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.714642    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9vvff","openshift-image-registry/node-ca-8549s","openshift-multus/network-metrics-daemon-xfkbj","openshift-network-operator/iptables-alerter-hcr9c","openshift-ovn-kubernetes/ovnkube-node-rwj67","kube-system/global-pull-secret-syncer-r7st8","openshift-cluster-node-tuning-operator/tuned-t7h7r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal","openshift-multus/multus-additional-cni-plugins-j7bwx","openshift-multus/multus-s5z52","openshift-network-diagnostics/network-check-target-qm4mp","kube-system/konnectivity-agent-vhmcl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"]
Jul 21 01:53:53.716390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.716368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.717579 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.717549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.718718 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.718662    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:53.718807 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.718779    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:53:53.719133 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.719108    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.719268 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.719163    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j8vwl\""
Jul 21 01:53:53.719268 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.719235    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.719921 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.719899    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.720033 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.720007    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:53:53.720151 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.720132    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 01:53:53.720419 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.720381    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.720518 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.720441    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lmgwf\""
Jul 21 01:53:53.720794 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.720778    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.721619 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.721602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.722380 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.722359    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 01:53:53.722482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.722362    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.722482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.722384    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.722482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.722382    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fzgwr\""
Jul 21 01:53:53.722890 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.722872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.722978 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.722956    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:53:53.724112 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.724092    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z4w66\""
Jul 21 01:53:53.724325 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.724297    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.724805 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.724789    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 01:53:53.724805 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.724800    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 01:53:53.725084 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.725070    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 01:53:53.725423 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.725405    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.725509 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.725407    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.725509 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.725479    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 01:53:53.725734 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.725717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.726609 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.726592    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.726697 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.726611    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m7ccq\""
Jul 21 01:53:53.727057 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.727041    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.727449 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.727433    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.728193 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.728175    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 01:53:53.728331 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.728315    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 01:53:53.728465 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.728449    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:53.728536 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.728510    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:53:53.728672 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.728655    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.728880 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.728862    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lp26h\""
Jul 21 01:53:53.728921 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.728900    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 01:53:53.729163 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.729130    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.729718 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.729697    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rls7d\""
Jul 21 01:53:53.729816 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.729743    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 01:53:53.729816 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.729759    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.731286 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.731262    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"]
Jul 21 01:53:53.731374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.731345    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.732506 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.732350    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 01:53:53.732506 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.732496    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-82qt6\""
Jul 21 01:53:53.732648 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.732565    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 01:53:53.733932 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.733915    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m6w29\""
Jul 21 01:53:53.733932 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.733923    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 01:53:53.734086 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.733962    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 01:53:53.734086 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.733999    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 01:53:53.777396 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.777349    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 01:48:53 +0000 UTC" deadline="2028-03-08 18:56:37.431855027 +0000 UTC"
Jul 21 01:53:53.777396 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.777392    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14321h2m43.654464961s"
Jul 21 01:53:53.781366 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.781346    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 01:53:53.782144 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.782128    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 01:53:53.785589 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4545n\" (UniqueName: \"kubernetes.io/projected/ea8ab9ae-87cc-426f-9316-cd9042508eb7-kube-api-access-4545n\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.785696 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-ovnkube-config\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.785696 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785618    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysconfig\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.785696 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtvq8\" (UniqueName: \"kubernetes.io/projected/d064c2a4-9b72-43a9-99ce-398a0af62ae9-kube-api-access-mtvq8\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.785696 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-conf-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.785696 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-etc-kubernetes\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785730    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-device-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-ovnkube-script-lib\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysctl-conf\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-socket-dir-parent\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-cni-bin\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-host\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-kubelet\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-node-log\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.785951 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5568fc66-bd91-4463-aa4b-d06acc5ee517-dbus\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.785989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xlpn\" (UniqueName: \"kubernetes.io/projected/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-kube-api-access-8xlpn\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-cnibin\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-os-release\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-cni-multus\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/117814c7-fce9-4cd1-be4c-6763b7bc01f7-tmp-dir\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d43fad76-9737-4cdf-ad01-0d4bbce7c011-konnectivity-ca\") pod \"konnectivity-agent-vhmcl\" (UID: \"d43fad76-9737-4cdf-ad01-0d4bbce7c011\") " pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786156    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-log-socket\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whq4w\" (UniqueName: \"kubernetes.io/projected/117814c7-fce9-4cd1-be4c-6763b7bc01f7-kube-api-access-whq4w\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786209    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-os-release\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5zl4\" (UniqueName: \"kubernetes.io/projected/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-kube-api-access-p5zl4\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-systemd\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-cni-bin\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckfs\" (UniqueName: \"kubernetes.io/projected/21953ca5-c250-48bf-8821-bc46c0774161-kube-api-access-6ckfs\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-multus-certs\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmzx\" (UniqueName: \"kubernetes.io/projected/32f56254-117d-4175-9c7f-f5d2209cc8fa-kube-api-access-jrmzx\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786410    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysctl-d\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-host\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-cni-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-cni-binary-copy\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dv5x\" (UniqueName: \"kubernetes.io/projected/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-kube-api-access-8dv5x\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786508    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxd8\" (UniqueName: \"kubernetes.io/projected/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-kube-api-access-9rxd8\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-run-ovn-kubernetes\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.786808 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786539    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-cni-netd\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-env-overrides\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-sys-fs\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786596    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-run-netns\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-etc-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21953ca5-c250-48bf-8821-bc46c0774161-ovn-node-metrics-cert\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5568fc66-bd91-4463-aa4b-d06acc5ee517-kubelet-config\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-system-cni-dir\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786712    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-netns\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786741    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-daemon-config\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d43fad76-9737-4cdf-ad01-0d4bbce7c011-agent-certs\") pod \"konnectivity-agent-vhmcl\" (UID: \"d43fad76-9737-4cdf-ad01-0d4bbce7c011\") " pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea8ab9ae-87cc-426f-9316-cd9042508eb7-iptables-alerter-script\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/117814c7-fce9-4cd1-be4c-6763b7bc01f7-hosts-file\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.787355 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786854    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-kubernetes\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-lib-modules\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-tuned\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-system-cni-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-k8s-cni-cncf-io\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-socket-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786972    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea8ab9ae-87cc-426f-9316-cd9042508eb7-host-slash\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.786986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-slash\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-modprobe-d\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-kubelet\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-registration-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787126    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-ovn\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.787778 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-cnibin\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-systemd\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787224    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-run\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-var-lib-kubelet\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d064c2a4-9b72-43a9-99ce-398a0af62ae9-tmp\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-var-lib-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-serviceca\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-systemd-units\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-sys\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.788190 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.787466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-hostroot\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.792766 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.792745    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:53:53.813733 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.813711    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gnww"
Jul 21 01:53:53.823563 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.823533    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gnww"
Jul 21 01:53:53.888568 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-log-socket\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.888568 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-log-socket\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.888793 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq4w\" (UniqueName: \"kubernetes.io/projected/117814c7-fce9-4cd1-be4c-6763b7bc01f7-kube-api-access-whq4w\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.888793 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-os-release\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.888793 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888634    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.888793 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5zl4\" (UniqueName: \"kubernetes.io/projected/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-kube-api-access-p5zl4\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.888793 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888735    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-os-release\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-systemd\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-cni-bin\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-systemd\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ckfs\" (UniqueName: \"kubernetes.io/projected/21953ca5-c250-48bf-8821-bc46c0774161-kube-api-access-6ckfs\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888930    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-cni-bin\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-multus-certs\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.888992    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmzx\" (UniqueName: \"kubernetes.io/projected/32f56254-117d-4175-9c7f-f5d2209cc8fa-kube-api-access-jrmzx\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysctl-d\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.889056 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889053    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-multus-certs\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-host\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-host\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889162    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-cni-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-cni-binary-copy\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dv5x\" (UniqueName: \"kubernetes.io/projected/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-kube-api-access-8dv5x\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxd8\" (UniqueName: \"kubernetes.io/projected/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-kube-api-access-9rxd8\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889293    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-cni-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-run-ovn-kubernetes\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889295    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysctl-d\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-cni-netd\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-env-overrides\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-run-ovn-kubernetes\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-sys-fs\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889419    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-run-netns\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.889673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889444    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-cni-netd\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-etc-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889468    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-sys-fs\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889499    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-run-netns\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21953ca5-c250-48bf-8821-bc46c0774161-ovn-node-metrics-cert\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-etc-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5568fc66-bd91-4463-aa4b-d06acc5ee517-kubelet-config\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-system-cni-dir\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889624    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-netns\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889673    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-netns\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-system-cni-dir\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5568fc66-bd91-4463-aa4b-d06acc5ee517-kubelet-config\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.890466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-daemon-config\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d43fad76-9737-4cdf-ad01-0d4bbce7c011-agent-certs\") pod \"konnectivity-agent-vhmcl\" (UID: \"d43fad76-9737-4cdf-ad01-0d4bbce7c011\") " pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea8ab9ae-87cc-426f-9316-cd9042508eb7-iptables-alerter-script\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/117814c7-fce9-4cd1-be4c-6763b7bc01f7-hosts-file\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-kubernetes\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-lib-modules\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889924    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-env-overrides\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-tuned\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.889995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-system-cni-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-k8s-cni-cncf-io\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890027    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/117814c7-fce9-4cd1-be4c-6763b7bc01f7-hosts-file\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890047    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-socket-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea8ab9ae-87cc-426f-9316-cd9042508eb7-host-slash\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-slash\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.891098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-modprobe-d\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-socket-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-kubelet\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890207    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-kubernetes\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890336    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-system-cni-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-registration-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-ovn\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-cnibin\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-systemd\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-run\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.891941 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-var-lib-kubelet\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d064c2a4-9b72-43a9-99ce-398a0af62ae9-tmp\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890634    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-daemon-config\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890655    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-var-lib-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890747    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-cni-binary-copy\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-lib-modules\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-slash\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-serviceca\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-systemd-units\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-modprobe-d\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-run-k8s-cni-cncf-io\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.892662 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890319    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea8ab9ae-87cc-426f-9316-cd9042508eb7-host-slash\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890915    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea8ab9ae-87cc-426f-9316-cd9042508eb7-iptables-alerter-script\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890948    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-ovn\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.890972    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-systemd\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891017    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-registration-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.891088    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.891180    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:54.391157276 +0000 UTC m=+2.132963623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-serviceca\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891427    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-kubelet\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32f56254-117d-4175-9c7f-f5d2209cc8fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-sys\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891471    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-systemd-units\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891522    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-run-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.893447 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32f56254-117d-4175-9c7f-f5d2209cc8fa-cnibin\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-var-lib-kubelet\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-run\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-hostroot\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891578    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-var-lib-openvswitch\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4545n\" (UniqueName: \"kubernetes.io/projected/ea8ab9ae-87cc-426f-9316-cd9042508eb7-kube-api-access-4545n\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-sys\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-hostroot\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-ovnkube-config\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysconfig\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysconfig\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtvq8\" (UniqueName: \"kubernetes.io/projected/d064c2a4-9b72-43a9-99ce-398a0af62ae9-kube-api-access-mtvq8\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-conf-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-etc-kubernetes\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.891994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-device-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-ovnkube-script-lib\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysctl-conf\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-socket-dir-parent\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892120    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-cni-bin\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-host\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892167    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-kubelet\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-node-log\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892226    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-conf-dir\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892229    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5568fc66-bd91-4463-aa4b-d06acc5ee517-dbus\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892309    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-etc-kubernetes\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892300    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-cni-bin\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892321    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-ovnkube-config\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-host\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.894685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xlpn\" (UniqueName: \"kubernetes.io/projected/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-kube-api-access-8xlpn\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-cnibin\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-node-log\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-os-release\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21953ca5-c250-48bf-8821-bc46c0774161-host-kubelet\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892494    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-cni-multus\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-multus-socket-dir-parent\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-host-var-lib-cni-multus\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-device-dir\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/117814c7-fce9-4cd1-be4c-6763b7bc01f7-tmp-dir\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d43fad76-9737-4cdf-ad01-0d4bbce7c011-konnectivity-ca\") pod \"konnectivity-agent-vhmcl\" (UID: \"d43fad76-9737-4cdf-ad01-0d4bbce7c011\") " pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5568fc66-bd91-4463-aa4b-d06acc5ee517-dbus\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892830    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21953ca5-c250-48bf-8821-bc46c0774161-ovnkube-script-lib\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.895240 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.892862    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.892965    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:54.392946757 +0000 UTC m=+2.134753080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892967    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-sysctl-conf\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.892995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/117814c7-fce9-4cd1-be4c-6763b7bc01f7-tmp-dir\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.893041    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-cnibin\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.893157    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-os-release\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.893526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d43fad76-9737-4cdf-ad01-0d4bbce7c011-konnectivity-ca\") pod \"konnectivity-agent-vhmcl\" (UID: \"d43fad76-9737-4cdf-ad01-0d4bbce7c011\") " pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.894254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d064c2a4-9b72-43a9-99ce-398a0af62ae9-tmp\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.894292    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d064c2a4-9b72-43a9-99ce-398a0af62ae9-etc-tuned\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.894404    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21953ca5-c250-48bf-8821-bc46c0774161-ovn-node-metrics-cert\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.895751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.894468    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d43fad76-9737-4cdf-ad01-0d4bbce7c011-agent-certs\") pod \"konnectivity-agent-vhmcl\" (UID: \"d43fad76-9737-4cdf-ad01-0d4bbce7c011\") " pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:53.904068 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.904033    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxd8\" (UniqueName: \"kubernetes.io/projected/9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42-kube-api-access-9rxd8\") pod \"node-ca-8549s\" (UID: \"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42\") " pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:53.904192 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.904102    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:53:53.904192 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.904151    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:53:53.904192 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.904168    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:53.904413 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:53.904241    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:54.404221194 +0000 UTC m=+2.146027536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:53.906788 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.906109    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4545n\" (UniqueName: \"kubernetes.io/projected/ea8ab9ae-87cc-426f-9316-cd9042508eb7-kube-api-access-4545n\") pod \"iptables-alerter-hcr9c\" (UID: \"ea8ab9ae-87cc-426f-9316-cd9042508eb7\") " pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:53.906788 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.906419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmzx\" (UniqueName: \"kubernetes.io/projected/32f56254-117d-4175-9c7f-f5d2209cc8fa-kube-api-access-jrmzx\") pod \"multus-additional-cni-plugins-j7bwx\" (UID: \"32f56254-117d-4175-9c7f-f5d2209cc8fa\") " pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:53.906788 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.906569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whq4w\" (UniqueName: \"kubernetes.io/projected/117814c7-fce9-4cd1-be4c-6763b7bc01f7-kube-api-access-whq4w\") pod \"node-resolver-9vvff\" (UID: \"117814c7-fce9-4cd1-be4c-6763b7bc01f7\") " pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:53.909874 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.908683    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ckfs\" (UniqueName: \"kubernetes.io/projected/21953ca5-c250-48bf-8821-bc46c0774161-kube-api-access-6ckfs\") pod \"ovnkube-node-rwj67\" (UID: \"21953ca5-c250-48bf-8821-bc46c0774161\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:53.909874 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.908720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dv5x\" (UniqueName: \"kubernetes.io/projected/a09b851a-6064-47cc-8bdc-6e0bb1d99ddc-kube-api-access-8dv5x\") pod \"aws-ebs-csi-driver-node-7xh7f\" (UID: \"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:53.910805 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.910315    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtvq8\" (UniqueName: \"kubernetes.io/projected/d064c2a4-9b72-43a9-99ce-398a0af62ae9-kube-api-access-mtvq8\") pod \"tuned-t7h7r\" (UID: \"d064c2a4-9b72-43a9-99ce-398a0af62ae9\") " pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:53.910805 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.910392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xlpn\" (UniqueName: \"kubernetes.io/projected/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-kube-api-access-8xlpn\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:53.910805 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.910712    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5zl4\" (UniqueName: \"kubernetes.io/projected/30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b-kube-api-access-p5zl4\") pod \"multus-s5z52\" (UID: \"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b\") " pod="openshift-multus/multus-s5z52"
Jul 21 01:53:53.914827 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:53.914807    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:54.049781 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.049705    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7h7r"
Jul 21 01:53:54.066487 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.066454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8549s"
Jul 21 01:53:54.073727 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.073698    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hcr9c"
Jul 21 01:53:54.075897 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.075834    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:53:54.108958 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.108926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9vvff"
Jul 21 01:53:54.124751 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.124727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j7bwx"
Jul 21 01:53:54.139199 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.139176    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s5z52"
Jul 21 01:53:54.154106 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.154078    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:53:54.158351 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.158332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f"
Jul 21 01:53:54.166056 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.166014    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8164ea24c973945e2299d7670db9fc95.slice/crio-e993e3f3edbdd8f44387c99f49bd612237b65753fae9e1ca684a6a254a8871a5 WatchSource:0}: Error finding container e993e3f3edbdd8f44387c99f49bd612237b65753fae9e1ca684a6a254a8871a5: Status 404 returned error can't find the container with id e993e3f3edbdd8f44387c99f49bd612237b65753fae9e1ca684a6a254a8871a5
Jul 21 01:53:54.166505 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.166484    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ad6f3a_7a28_4ef4_abc5_7a1fd3dfc83b.slice/crio-a620ff9588b687219559af6afec0df417eb7f6da2faa03a9688663491964c94c WatchSource:0}: Error finding container a620ff9588b687219559af6afec0df417eb7f6da2faa03a9688663491964c94c: Status 404 returned error can't find the container with id a620ff9588b687219559af6afec0df417eb7f6da2faa03a9688663491964c94c
Jul 21 01:53:54.171322 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.171232    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:53:54.180148 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.180126    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09b851a_6064_47cc_8bdc_6e0bb1d99ddc.slice/crio-3f49befba188413be310335a314ca4d82abc4cf0a5dc43c708435e87b4041f87 WatchSource:0}: Error finding container 3f49befba188413be310335a314ca4d82abc4cf0a5dc43c708435e87b4041f87: Status 404 returned error can't find the container with id 3f49befba188413be310335a314ca4d82abc4cf0a5dc43c708435e87b4041f87
Jul 21 01:53:54.180758 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.180731    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1b50bc9c76b160afe236717f6e8775.slice/crio-e1fe100104499aa3a3e8fbe15c4f5af08ff0f568ad87b4e62b1737478a1c8447 WatchSource:0}: Error finding container e1fe100104499aa3a3e8fbe15c4f5af08ff0f568ad87b4e62b1737478a1c8447: Status 404 returned error can't find the container with id e1fe100104499aa3a3e8fbe15c4f5af08ff0f568ad87b4e62b1737478a1c8447
Jul 21 01:53:54.181785 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.181766    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43fad76_9737_4cdf_ad01_0d4bbce7c011.slice/crio-00ead0431cc5f4283893daf8c0cabab0a127f68ea36ed39fa160699074c13590 WatchSource:0}: Error finding container 00ead0431cc5f4283893daf8c0cabab0a127f68ea36ed39fa160699074c13590: Status 404 returned error can't find the container with id 00ead0431cc5f4283893daf8c0cabab0a127f68ea36ed39fa160699074c13590
Jul 21 01:53:54.394823 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.394741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:54.394823 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.394802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:54.394999 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.394877    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:54.394999 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.394893    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:54.394999 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.394946    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:55.394927276 +0000 UTC m=+3.136733602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:54.394999 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.394962    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:55.394955571 +0000 UTC m=+3.136761895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:54.412589 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.412556    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6997aa_dcff_43e1_83f9_d0e1dcf2ae42.slice/crio-c4613d01794a3776fa9d5640bfbecae8accd9009d83adc113b721d177756d104 WatchSource:0}: Error finding container c4613d01794a3776fa9d5640bfbecae8accd9009d83adc113b721d177756d104: Status 404 returned error can't find the container with id c4613d01794a3776fa9d5640bfbecae8accd9009d83adc113b721d177756d104
Jul 21 01:53:54.415799 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.415770    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21953ca5_c250_48bf_8821_bc46c0774161.slice/crio-f571c4eaf59888734907b09b2c450f7a4d20e45b810f87678851e4fc6ce92d81 WatchSource:0}: Error finding container f571c4eaf59888734907b09b2c450f7a4d20e45b810f87678851e4fc6ce92d81: Status 404 returned error can't find the container with id f571c4eaf59888734907b09b2c450f7a4d20e45b810f87678851e4fc6ce92d81
Jul 21 01:53:54.423611 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.423586    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8ab9ae_87cc_426f_9316_cd9042508eb7.slice/crio-9a2573beaba3d77887cc618a4704325c5357a5b232662ff22a86893ecfadf70c WatchSource:0}: Error finding container 9a2573beaba3d77887cc618a4704325c5357a5b232662ff22a86893ecfadf70c: Status 404 returned error can't find the container with id 9a2573beaba3d77887cc618a4704325c5357a5b232662ff22a86893ecfadf70c
Jul 21 01:53:54.495460 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.495421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:54.495616 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.495598    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:53:54.495663 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.495626    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:53:54.495663 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.495638    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:54.495731 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:54.495691    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:55.495674514 +0000 UTC m=+3.237480839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:54.649449 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.649352    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:54.798915 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.798868    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd064c2a4_9b72_43a9_99ce_398a0af62ae9.slice/crio-f0cef60810f039ed77962d6ea698a594ea923abe1a41df1319cbee73c77732be WatchSource:0}: Error finding container f0cef60810f039ed77962d6ea698a594ea923abe1a41df1319cbee73c77732be: Status 404 returned error can't find the container with id f0cef60810f039ed77962d6ea698a594ea923abe1a41df1319cbee73c77732be
Jul 21 01:53:54.825785 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.825745    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:48:54 +0000 UTC" deadline="2028-01-13 09:58:49.215692907 +0000 UTC"
Jul 21 01:53:54.825785 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.825775    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12992h4m54.389921164s"
Jul 21 01:53:54.862587 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.862556    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f56254_117d_4175_9c7f_f5d2209cc8fa.slice/crio-b7b3ccccc59705d9e075d9fdf966daf77beb99b8e4ae7012d4b3a1ea8fc31f9a WatchSource:0}: Error finding container b7b3ccccc59705d9e075d9fdf966daf77beb99b8e4ae7012d4b3a1ea8fc31f9a: Status 404 returned error can't find the container with id b7b3ccccc59705d9e075d9fdf966daf77beb99b8e4ae7012d4b3a1ea8fc31f9a
Jul 21 01:53:54.895874 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:53:54.895842    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117814c7_fce9_4cd1_be4c_6763b7bc01f7.slice/crio-6748e57a2cc48c072b356e02a6a6d72ff12b4c09b055df2be3d2980d5911939b WatchSource:0}: Error finding container 6748e57a2cc48c072b356e02a6a6d72ff12b4c09b055df2be3d2980d5911939b: Status 404 returned error can't find the container with id 6748e57a2cc48c072b356e02a6a6d72ff12b4c09b055df2be3d2980d5911939b
Jul 21 01:53:54.926281 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:54.926067    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:55.019169 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.019123    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:55.019169 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.019157    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:55.019446 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.019393    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:53:55.019512 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.019467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:55.019576 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.019558    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:53:55.020107 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.020071    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:53:55.028940 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.028888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"4b1b50bc9c76b160afe236717f6e8775","Type":"ContainerStarted","Data":"e1fe100104499aa3a3e8fbe15c4f5af08ff0f568ad87b4e62b1737478a1c8447"}
Jul 21 01:53:55.034144 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.034110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9vvff" event={"ID":"117814c7-fce9-4cd1-be4c-6763b7bc01f7","Type":"ContainerStarted","Data":"6748e57a2cc48c072b356e02a6a6d72ff12b4c09b055df2be3d2980d5911939b"}
Jul 21 01:53:55.037607 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.037578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"f571c4eaf59888734907b09b2c450f7a4d20e45b810f87678851e4fc6ce92d81"}
Jul 21 01:53:55.041698 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.041672    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8549s" event={"ID":"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42","Type":"ContainerStarted","Data":"c4613d01794a3776fa9d5640bfbecae8accd9009d83adc113b721d177756d104"}
Jul 21 01:53:55.044338 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.044295    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f" event={"ID":"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc","Type":"ContainerStarted","Data":"3f49befba188413be310335a314ca4d82abc4cf0a5dc43c708435e87b4041f87"}
Jul 21 01:53:55.050279 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.050202    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" event={"ID":"8164ea24c973945e2299d7670db9fc95","Type":"ContainerStarted","Data":"e993e3f3edbdd8f44387c99f49bd612237b65753fae9e1ca684a6a254a8871a5"}
Jul 21 01:53:55.073913 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.073871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s5z52" event={"ID":"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b","Type":"ContainerStarted","Data":"a620ff9588b687219559af6afec0df417eb7f6da2faa03a9688663491964c94c"}
Jul 21 01:53:55.084002 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.083962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerStarted","Data":"b7b3ccccc59705d9e075d9fdf966daf77beb99b8e4ae7012d4b3a1ea8fc31f9a"}
Jul 21 01:53:55.087327 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.087242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7h7r" event={"ID":"d064c2a4-9b72-43a9-99ce-398a0af62ae9","Type":"ContainerStarted","Data":"f0cef60810f039ed77962d6ea698a594ea923abe1a41df1319cbee73c77732be"}
Jul 21 01:53:55.090263 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.090228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hcr9c" event={"ID":"ea8ab9ae-87cc-426f-9316-cd9042508eb7","Type":"ContainerStarted","Data":"9a2573beaba3d77887cc618a4704325c5357a5b232662ff22a86893ecfadf70c"}
Jul 21 01:53:55.093015 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.092984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhmcl" event={"ID":"d43fad76-9737-4cdf-ad01-0d4bbce7c011","Type":"ContainerStarted","Data":"00ead0431cc5f4283893daf8c0cabab0a127f68ea36ed39fa160699074c13590"}
Jul 21 01:53:55.405044 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.405001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:55.405327 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.405093    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:55.405327 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.405227    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:55.405327 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.405318    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:57.405277646 +0000 UTC m=+5.147083969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:55.405804 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.405782    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:55.405901 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.405852    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:57.405833295 +0000 UTC m=+5.147639631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:55.506636 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.505964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:55.506636 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.506227    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:53:55.506636 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.506248    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:53:55.506636 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.506263    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:55.506636 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:55.506346    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:53:57.506325147 +0000 UTC m=+5.248131490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:55.826463 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.826297    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:48:54 +0000 UTC" deadline="2028-02-07 20:43:42.930584742 +0000 UTC"
Jul 21 01:53:55.826463 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:55.826369    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13602h49m47.104220745s"
Jul 21 01:53:56.635801 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:56.635552    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:53:57.019287 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:57.018062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:57.019287 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.018220    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:53:57.019287 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:57.018673    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:57.019287 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.018779    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:53:57.019287 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:57.019138    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:57.019287 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.019226    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:53:57.423638 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:57.423539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:57.423638 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:57.423630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:57.423880 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.423730    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:57.423880 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.423795    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:57.423880 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.423810    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:01.423787928 +0000 UTC m=+9.165594263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:53:57.423880 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.423855    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:01.423837245 +0000 UTC m=+9.165643569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:53:57.524935 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:57.524863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:57.525161 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.525142    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:53:57.525274 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.525172    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:53:57.525274 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.525188    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:57.525274 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:57.525252    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:01.525232103 +0000 UTC m=+9.267038441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:53:59.019331 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:59.018475    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:53:59.019331 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:59.018612    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:53:59.019331 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:59.019005    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:53:59.019331 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:59.019101    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:53:59.019331 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:53:59.019158    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:53:59.019331 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:53:59.019254    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:01.016100 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:01.016015    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:01.016100 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:01.016071    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:01.016639 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:01.016157    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:01.016639 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.016180    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:01.016639 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.016295    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:01.016639 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.016403    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:01.459801 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:01.459719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:01.459969 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:01.459808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:01.459969 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.459949    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:54:01.459969 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.459958    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:54:01.460139 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.460030    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:09.460009884 +0000 UTC m=+17.201816224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:54:01.460139 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.460068    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:09.460055818 +0000 UTC m=+17.201862152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:54:01.561643 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:01.561024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:01.561643 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.561183    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:54:01.561643 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.561203    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:54:01.561643 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.561215    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:54:01.561643 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:01.561296    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:09.561278424 +0000 UTC m=+17.303084758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:54:03.017194 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:03.017158    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:03.017194 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:03.017184    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:03.017648 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:03.017325    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:03.017954 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:03.017793    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:03.017954 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:03.017792    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:03.017954 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:03.017910    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:05.016697 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:05.016651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:05.017173 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:05.016651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:05.017173 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:05.016797    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:05.017173 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:05.016866    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:05.017173 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:05.016871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:05.017173 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:05.016953    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:07.016374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:07.016286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:07.016374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:07.016315    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:07.016374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:07.016341    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:07.016877 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:07.016488    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:07.016877 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:07.016570    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:07.016877 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:07.016688    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:09.015890 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:09.015856    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:09.016332 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:09.015856    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:09.016332 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.015970    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:09.016332 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:09.016147    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:09.016498 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.016088    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:09.016694 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.016600    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:09.517569 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:09.517526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:09.517721 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:09.517622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:09.517721 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.517708    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:54:09.517846 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.517758    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:54:09.517846 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.517792    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:25.517769993 +0000 UTC m=+33.259576328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:54:09.517846 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.517812    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:25.51780145 +0000 UTC m=+33.259607776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:54:09.618385 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:09.618326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:09.618575 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.618469    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:54:09.618575 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.618492    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:54:09.618575 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.618505    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:54:09.618575 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:09.618570    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:25.618553852 +0000 UTC m=+33.360360194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:54:11.015508 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:11.015471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:11.015983 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:11.015472    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:11.015983 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:11.015604    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:11.015983 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:11.015661    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:11.015983 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:11.015472    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:11.015983 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:11.015754    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:13.017160 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:13.017119    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:13.017626 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:13.017258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:13.017626 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:13.017283    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:13.017626 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:13.017257    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:13.017626 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:13.017402    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:13.017626 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:13.017494    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:15.015562 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:15.015487    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:15.015562 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:15.015509    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:15.016011 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:15.015666    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:15.016011 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:15.015757    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:15.016011 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:15.015803    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:15.016011 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:15.015870    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:16.155955 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.155553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7h7r" event={"ID":"d064c2a4-9b72-43a9-99ce-398a0af62ae9","Type":"ContainerStarted","Data":"4a903312dcbfac1c884cb346c4ffffe598b12663b2d504e179cb8da2648e5200"}
Jul 21 01:54:16.157001 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.156980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhmcl" event={"ID":"d43fad76-9737-4cdf-ad01-0d4bbce7c011","Type":"ContainerStarted","Data":"15650174f51c61fa182a40349d805d8a7c0848e414577f4bf13faea981acc61b"}
Jul 21 01:54:16.158407 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.158376    2574 generic.go:356] "Generic (PLEG): container finished" podID="4b1b50bc9c76b160afe236717f6e8775" containerID="3521256ab6ccb7cb12700c0a5316b711a8607cf6d17c0a32f39fff9de7c3d33c" exitCode=0
Jul 21 01:54:16.158546 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.158455    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"4b1b50bc9c76b160afe236717f6e8775","Type":"ContainerDied","Data":"3521256ab6ccb7cb12700c0a5316b711a8607cf6d17c0a32f39fff9de7c3d33c"}
Jul 21 01:54:16.159923 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.159903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9vvff" event={"ID":"117814c7-fce9-4cd1-be4c-6763b7bc01f7","Type":"ContainerStarted","Data":"3a61bf0318375d55d56f05e4dd39ccf16c8ecb3d9aea6a4353e1bfb1385f7144"}
Jul 21 01:54:16.162552 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.162536    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 01:54:16.162854 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.162834    2574 generic.go:356] "Generic (PLEG): container finished" podID="21953ca5-c250-48bf-8821-bc46c0774161" containerID="ec5df13d03f99e296383bf8def894219f4a9a0fd2b2f86b6786d451360fbf9fc" exitCode=1
Jul 21 01:54:16.162923 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.162896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"4622de09e8c029fe3064442cbd4d521d82a7df218390f5270801c931dbe346bb"}
Jul 21 01:54:16.162998 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.162968    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"caa6cf97de0efe59763300d00dc39074a0ae5ea720e1b60b4ee213c9f70000f5"}
Jul 21 01:54:16.163054 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.163041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"4e62eec776ee4b88ffb43d42a4255e59db2b98ac94f4df8d5a7e5fc950c9db3d"}
Jul 21 01:54:16.163095 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.163084    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"c17c9e28904aa453bc81ab0df5860fd59b9d3f379d8e212a2671877f766c9ce9"}
Jul 21 01:54:16.163140 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.163116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerDied","Data":"ec5df13d03f99e296383bf8def894219f4a9a0fd2b2f86b6786d451360fbf9fc"}
Jul 21 01:54:16.163183 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.163156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"c42c26538d430a3f87a2b78aed5ef1e5c4cf8a740110fa9be2695300d80034f4"}
Jul 21 01:54:16.164085 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.164066    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8549s" event={"ID":"9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42","Type":"ContainerStarted","Data":"738994f1f848ed61d77547b5cc158597454ac0fc0d25408dcb735bc9a888c9ea"}
Jul 21 01:54:16.165250 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.165217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f" event={"ID":"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc","Type":"ContainerStarted","Data":"98c56a038bc1e6f5c839f29dedeafe2f7f8e144fffddce923d1bcc3128d9e423"}
Jul 21 01:54:16.166635 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.166614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" event={"ID":"8164ea24c973945e2299d7670db9fc95","Type":"ContainerStarted","Data":"67c4e1a2b34ed333a7fa767e8dabc4b80281e89d401717aa36615bb3c421d88b"}
Jul 21 01:54:16.168001 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.167982    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s5z52" event={"ID":"30ad6f3a-7a28-4ef4-abc5-7a1fd3dfc83b","Type":"ContainerStarted","Data":"0f09b68aea933bd421a16d58e2d9bf14aa959652655d4450cb0c8474490b2cff"}
Jul 21 01:54:16.169342 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.169319    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56254-117d-4175-9c7f-f5d2209cc8fa" containerID="a4f6ffbc575c7514a8db3d376327b72ef0cac736c992353d877eebf8db5b4452" exitCode=0
Jul 21 01:54:16.169422 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.169345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerDied","Data":"a4f6ffbc575c7514a8db3d376327b72ef0cac736c992353d877eebf8db5b4452"}
Jul 21 01:54:16.172657 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.172614    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t7h7r" podStartSLOduration=2.969445982 podStartE2EDuration="23.172602882s" totalImagesPullingTime="20.2031569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:16.172079189 +0000 UTC m=+23.913885531" watchObservedRunningTime="2026-07-21 01:54:16.172602882 +0000 UTC m=+23.914409223"
Jul 21 01:54:16.210285 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.209997    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vhmcl" podStartSLOduration=10.775739685 podStartE2EDuration="23.209975733s" totalImagesPullingTime="12.434236048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:16.209963661 +0000 UTC m=+23.951770018" watchObservedRunningTime="2026-07-21 01:54:16.209975733 +0000 UTC m=+23.951782075"
Jul 21 01:54:16.237398 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.237347    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8549s" podStartSLOduration=2.64760681 podStartE2EDuration="23.237327015s" totalImagesPullingTime="20.589720205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:16.236786037 +0000 UTC m=+23.978592381" watchObservedRunningTime="2026-07-21 01:54:16.237327015 +0000 UTC m=+23.979133384"
Jul 21 01:54:16.252505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.250942    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9vvff" podStartSLOduration=3.165231656 podStartE2EDuration="23.250925708s" totalImagesPullingTime="20.085694052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:16.250313645 +0000 UTC m=+23.992119980" watchObservedRunningTime="2026-07-21 01:54:16.250925708 +0000 UTC m=+23.992732048"
Jul 21 01:54:16.281649 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.281536    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s5z52" podStartSLOduration=2.10025238 podStartE2EDuration="23.281520392s" totalImagesPullingTime="21.181268012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:16.281326265 +0000 UTC m=+24.023132618" watchObservedRunningTime="2026-07-21 01:54:16.281520392 +0000 UTC m=+24.023326732"
Jul 21 01:54:16.281812 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.281698    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" podStartSLOduration=22.281690434 podStartE2EDuration="22.281690434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:16.264676739 +0000 UTC m=+24.006483081" watchObservedRunningTime="2026-07-21 01:54:16.281690434 +0000 UTC m=+24.023496776"
Jul 21 01:54:16.769666 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.769600    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:54:16.820297 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.820259    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:54:16.820843 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:16.820828    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:54:17.016248 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.016209    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:17.016396 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.016229    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:17.016396 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:17.016329    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:17.016396 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:17.016384    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:17.016497 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.016417    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:17.016531 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:17.016492    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:17.074844 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.074820    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 01:54:17.172550 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.172515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hcr9c" event={"ID":"ea8ab9ae-87cc-426f-9316-cd9042508eb7","Type":"ContainerStarted","Data":"e213807921a6d78d364b4ebce0ffbd18689fc178b4a79877b2ba601be0e01822"}
Jul 21 01:54:17.174562 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.174515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"4b1b50bc9c76b160afe236717f6e8775","Type":"ContainerStarted","Data":"9202cb33eb7d9668a3c6b043a121ef085c0e1a48d543f0f2a71b4d1b70f761d6"}
Jul 21 01:54:17.176550 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.176523    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f" event={"ID":"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc","Type":"ContainerStarted","Data":"5c2785ca46e1a22c4946ee3622d1fb8e2c4bd15775a60b2ca1c87db10311f483"}
Jul 21 01:54:17.177582 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.177560    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vhmcl"
Jul 21 01:54:17.187832 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.187789    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hcr9c" podStartSLOduration=3.62926326 podStartE2EDuration="24.187774679s" totalImagesPullingTime="20.558511419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:17.187001777 +0000 UTC m=+24.928808119" watchObservedRunningTime="2026-07-21 01:54:17.187774679 +0000 UTC m=+24.929581019"
Jul 21 01:54:17.201042 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.200998    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" podStartSLOduration=23.200984318 podStartE2EDuration="23.200984318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:17.200718539 +0000 UTC m=+24.942524881" watchObservedRunningTime="2026-07-21 01:54:17.200984318 +0000 UTC m=+24.942790658"
Jul 21 01:54:17.903094 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.902941    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T01:54:17.074836881Z","UUID":"2d6e630e-e853-434e-8b8e-4b161fe3147f","Handler":null,"Name":"","Endpoint":""}
Jul 21 01:54:17.904768 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.904741    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 01:54:17.904906 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:17.904793    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 01:54:18.182649 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:18.182568    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 01:54:18.183181 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:18.183026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"fab50abbd902b0f4cc9f9561acc14e18994d231c4452fcaff4e15d3f4676332e"}
Jul 21 01:54:19.019170 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:19.019131    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:19.019170 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:19.019165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:19.019483 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:19.019260    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:19.019483 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:19.019274    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:19.019483 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:19.019349    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:19.019483 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:19.019399    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:19.187713 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:19.187676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f" event={"ID":"a09b851a-6064-47cc-8bdc-6e0bb1d99ddc","Type":"ContainerStarted","Data":"ebdb5a6122962522e01107575ceef2b7568490a1fb3cc1eafdb42e9e8a41e9f3"}
Jul 21 01:54:19.206445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:19.206394    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xh7f" podStartSLOduration=2.788575723 podStartE2EDuration="26.206378934s" totalImagesPullingTime="23.417803211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:19.204713932 +0000 UTC m=+26.946520266" watchObservedRunningTime="2026-07-21 01:54:19.206378934 +0000 UTC m=+26.948185273"
Jul 21 01:54:21.019631 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:21.019601    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:21.020078 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:21.019711    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:21.020078 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:21.019783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:21.020078 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:21.019875    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:21.020078 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:21.019914    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:21.020078 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:21.020029    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:22.196791 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.196555    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 01:54:22.197602 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.197106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"1f0f56e236e58ac18fcc6edf71287d5c6f99f49163cb1d6f9cba72f684510861"}
Jul 21 01:54:22.197602 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.197378    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:54:22.197602 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.197586    2574 scope.go:117] "RemoveContainer" containerID="ec5df13d03f99e296383bf8def894219f4a9a0fd2b2f86b6786d451360fbf9fc"
Jul 21 01:54:22.199101 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.199069    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56254-117d-4175-9c7f-f5d2209cc8fa" containerID="f04814d4d178366886b4cfb68781e55f15b05943e5a56634cf93038c938c5bdc" exitCode=0
Jul 21 01:54:22.199223 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.199114    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerDied","Data":"f04814d4d178366886b4cfb68781e55f15b05943e5a56634cf93038c938c5bdc"}
Jul 21 01:54:22.213858 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:22.213835    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:54:23.022261 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.022213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:23.022507 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.022277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:23.022507 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:23.022357    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:23.022507 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:23.022427    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:23.022507 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.022455    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:23.022737 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:23.022544    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:23.204583 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.204556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 01:54:23.204984 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.204961    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" event={"ID":"21953ca5-c250-48bf-8821-bc46c0774161","Type":"ContainerStarted","Data":"5b4e9829434ca71f84ce6d59933efda620c16a3dffc6ae48ee35a9b74713bbdf"}
Jul 21 01:54:23.205250 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.205203    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:54:23.205400 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.205301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:54:23.220414 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.220384    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:54:23.233953 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.233911    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67" podStartSLOduration=9.599722738 podStartE2EDuration="30.233898287s" totalImagesPullingTime="20.634175549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:23.232573782 +0000 UTC m=+30.974380122" watchObservedRunningTime="2026-07-21 01:54:23.233898287 +0000 UTC m=+30.975704628"
Jul 21 01:54:23.686728 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.686655    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xfkbj"]
Jul 21 01:54:23.686861 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.686766    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:23.686861 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:23.686853    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:23.689813 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.689783    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm4mp"]
Jul 21 01:54:23.689952 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.689883    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:23.690008 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:23.689975    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:23.690466 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.690437    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r7st8"]
Jul 21 01:54:23.690596 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:23.690524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:23.690662 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:23.690600    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:24.209409 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:24.209378    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56254-117d-4175-9c7f-f5d2209cc8fa" containerID="a39b4b32e15e1d7fc1ba3ebee55ac82377dde5c23a2d23896bc2f33489a93d6a" exitCode=0
Jul 21 01:54:24.209828 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:24.209465    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerDied","Data":"a39b4b32e15e1d7fc1ba3ebee55ac82377dde5c23a2d23896bc2f33489a93d6a"}
Jul 21 01:54:25.015936 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:25.015905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:25.016089 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.016011    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:25.538697 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:25.538626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:25.538697 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:25.538679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:25.539065 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.538791    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:54:25.539065 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.538795    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:54:25.539065 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.538842    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret podName:5568fc66-bd91-4463-aa4b-d06acc5ee517 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:57.538828436 +0000 UTC m=+65.280634759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret") pod "global-pull-secret-syncer-r7st8" (UID: "5568fc66-bd91-4463-aa4b-d06acc5ee517") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:54:25.539065 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.538856    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:57.538849533 +0000 UTC m=+65.280655855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:54:25.639041 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:25.639008    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:25.639209 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.639129    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:54:25.639209 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.639146    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:54:25.639209 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.639154    2574 projected.go:196] Error preparing data for projected volume kube-api-access-96t47 for pod openshift-network-diagnostics/network-check-target-qm4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:54:25.639209 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:25.639199    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47 podName:95cad266-8439-46ce-a25b-4a24751f5e12 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:57.639187507 +0000 UTC m=+65.380993830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-96t47" (UniqueName: "kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47") pod "network-check-target-qm4mp" (UID: "95cad266-8439-46ce-a25b-4a24751f5e12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:54:26.016174 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:26.016147    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:26.016174 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:26.016159    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:26.016422 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:26.016267    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:26.016422 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:26.016403    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:26.216570 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:26.216537    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56254-117d-4175-9c7f-f5d2209cc8fa" containerID="2d414b2b39858d8ae2b6e2cea617ef5e73cfe9ec3d32f2229d78fa9387aa849e" exitCode=0
Jul 21 01:54:26.216744 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:26.216586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerDied","Data":"2d414b2b39858d8ae2b6e2cea617ef5e73cfe9ec3d32f2229d78fa9387aa849e"}
Jul 21 01:54:27.016132 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:27.016098    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:27.016619 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:27.016224    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4mp" podUID="95cad266-8439-46ce-a25b-4a24751f5e12"
Jul 21 01:54:28.016109 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.015858    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:28.016299 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.015894    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:28.016299 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:28.016205    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:54:28.016299 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:28.016281    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r7st8" podUID="5568fc66-bd91-4463-aa4b-d06acc5ee517"
Jul 21 01:54:28.018830 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.018809    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeReady"
Jul 21 01:54:28.018953 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.018930    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 01:54:28.062669 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.062584    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4fw89"]
Jul 21 01:54:28.064900 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.064814    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.065436 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.065410    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cpswz"]
Jul 21 01:54:28.067163 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.067144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.067810 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.067762    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cbx74\""
Jul 21 01:54:28.067810 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.067801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 01:54:28.067972 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.067813    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 01:54:28.070076 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.070042    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 01:54:28.070175 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.070141    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g2jzl\""
Jul 21 01:54:28.070324 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.070295    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 01:54:28.070437 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.070414    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 01:54:28.075928 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.075899    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4fw89"]
Jul 21 01:54:28.079667 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.079644    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cpswz"]
Jul 21 01:54:28.159196 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.159159    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e26a01e-f32f-4d79-9b03-115e2e69d208-cert\") pod \"ingress-canary-cpswz\" (UID: \"9e26a01e-f32f-4d79-9b03-115e2e69d208\") " pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.159390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.159203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.159390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.159326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/928398f5-9efb-4fe2-9e95-4493538183e9-config-volume\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.159390 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.159379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/928398f5-9efb-4fe2-9e95-4493538183e9-tmp-dir\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.159511 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.159482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghtds\" (UniqueName: \"kubernetes.io/projected/928398f5-9efb-4fe2-9e95-4493538183e9-kube-api-access-ghtds\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.159559 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.159534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zskzn\" (UniqueName: \"kubernetes.io/projected/9e26a01e-f32f-4d79-9b03-115e2e69d208-kube-api-access-zskzn\") pod \"ingress-canary-cpswz\" (UID: \"9e26a01e-f32f-4d79-9b03-115e2e69d208\") " pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.259880 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.259843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/928398f5-9efb-4fe2-9e95-4493538183e9-tmp-dir\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.260070 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.259907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtds\" (UniqueName: \"kubernetes.io/projected/928398f5-9efb-4fe2-9e95-4493538183e9-kube-api-access-ghtds\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.260070 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.259953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zskzn\" (UniqueName: \"kubernetes.io/projected/9e26a01e-f32f-4d79-9b03-115e2e69d208-kube-api-access-zskzn\") pod \"ingress-canary-cpswz\" (UID: \"9e26a01e-f32f-4d79-9b03-115e2e69d208\") " pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.260070 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.259974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e26a01e-f32f-4d79-9b03-115e2e69d208-cert\") pod \"ingress-canary-cpswz\" (UID: \"9e26a01e-f32f-4d79-9b03-115e2e69d208\") " pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.260070 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.259993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.260070 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.260023    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/928398f5-9efb-4fe2-9e95-4493538183e9-config-volume\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.260314 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.260285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/928398f5-9efb-4fe2-9e95-4493538183e9-tmp-dir\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.260395 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:28.260379    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:28.260454 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:28.260443    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:28.76042391 +0000 UTC m=+36.502230236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:54:28.260588 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.260568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/928398f5-9efb-4fe2-9e95-4493538183e9-config-volume\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.264899 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.264878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e26a01e-f32f-4d79-9b03-115e2e69d208-cert\") pod \"ingress-canary-cpswz\" (UID: \"9e26a01e-f32f-4d79-9b03-115e2e69d208\") " pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.271661 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.271629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zskzn\" (UniqueName: \"kubernetes.io/projected/9e26a01e-f32f-4d79-9b03-115e2e69d208-kube-api-access-zskzn\") pod \"ingress-canary-cpswz\" (UID: \"9e26a01e-f32f-4d79-9b03-115e2e69d208\") " pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.271784 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.271683    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghtds\" (UniqueName: \"kubernetes.io/projected/928398f5-9efb-4fe2-9e95-4493538183e9-kube-api-access-ghtds\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.384735 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.384650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cpswz"
Jul 21 01:54:28.536468 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.536435    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cpswz"]
Jul 21 01:54:28.539838 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:54:28.539811    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e26a01e_f32f_4d79_9b03_115e2e69d208.slice/crio-1973fbb3578bebbc6f6f5b7ecf01bc12997f683b9466b3e5a67c231123498770 WatchSource:0}: Error finding container 1973fbb3578bebbc6f6f5b7ecf01bc12997f683b9466b3e5a67c231123498770: Status 404 returned error can't find the container with id 1973fbb3578bebbc6f6f5b7ecf01bc12997f683b9466b3e5a67c231123498770
Jul 21 01:54:28.764158 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:28.764122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:28.764348 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:28.764300    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:28.764413 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:28.764366    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:29.764349848 +0000 UTC m=+37.506156166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:54:29.016401 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:29.016318    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:29.019695 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:29.019664    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:54:29.020837 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:29.020812    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g586n\""
Jul 21 01:54:29.020964 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:29.020893    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:54:29.225480 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:29.225439    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cpswz" event={"ID":"9e26a01e-f32f-4d79-9b03-115e2e69d208","Type":"ContainerStarted","Data":"1973fbb3578bebbc6f6f5b7ecf01bc12997f683b9466b3e5a67c231123498770"}
Jul 21 01:54:29.773013 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:29.772967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:29.773210 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:29.773112    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:29.773210 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:29.773194    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:31.7731715 +0000 UTC m=+39.514977835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:54:30.016328 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:30.016295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:30.016483 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:30.016295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:30.019380 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:30.019355    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:54:30.019486 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:30.019395    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:54:30.019535 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:30.019358    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gmrt\""
Jul 21 01:54:31.789493 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:31.789459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:31.789870 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:31.789586    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:31.789870 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:31.789637    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:35.789622438 +0000 UTC m=+43.531428757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:54:32.235646 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:32.235609    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56254-117d-4175-9c7f-f5d2209cc8fa" containerID="46f8d5d12a45a036a46e771ab003e008b5c3c4e054e2eb9fd2c3575cb0d3f3e3" exitCode=0
Jul 21 01:54:32.235785 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:32.235708    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerDied","Data":"46f8d5d12a45a036a46e771ab003e008b5c3c4e054e2eb9fd2c3575cb0d3f3e3"}
Jul 21 01:54:32.237193 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:32.237168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cpswz" event={"ID":"9e26a01e-f32f-4d79-9b03-115e2e69d208","Type":"ContainerStarted","Data":"df81824aada94a62655ced4bf3ce608990ea19da109537b056bf93c4d84815c2"}
Jul 21 01:54:32.280865 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:32.280814    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cpswz" podStartSLOduration=0.996945217 podStartE2EDuration="4.280795202s" totalImagesPullingTime="3.283849985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:32.280135629 +0000 UTC m=+40.021941973" watchObservedRunningTime="2026-07-21 01:54:32.280795202 +0000 UTC m=+40.022601542"
Jul 21 01:54:33.242720 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:33.242686    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56254-117d-4175-9c7f-f5d2209cc8fa" containerID="4ff2f93f9ec31436b70b57b5ea03834074362fa375dd6f5262e1124c23d502d9" exitCode=0
Jul 21 01:54:33.243177 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:33.242765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerDied","Data":"4ff2f93f9ec31436b70b57b5ea03834074362fa375dd6f5262e1124c23d502d9"}
Jul 21 01:54:34.250402 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:34.250365    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" event={"ID":"32f56254-117d-4175-9c7f-f5d2209cc8fa","Type":"ContainerStarted","Data":"02f886f9111ef856a02d6022e65d7d40622cc40c579cd09e27bc5655db57e9c4"}
Jul 21 01:54:35.817731 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:35.817686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:35.818111 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:35.817851    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:35.818111 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:35.817922    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:43.817903208 +0000 UTC m=+51.559709537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:54:43.877201 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:43.877159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:43.877688 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:43.877321    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:43.877688 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:43.877384    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:54:59.877364959 +0000 UTC m=+67.619171286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:54:55.240389 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:55.240362    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwj67"
Jul 21 01:54:55.271536 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:55.271489    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j7bwx" podStartSLOduration=28.880725777 podStartE2EDuration="1m2.271472633s" totalImagesPullingTime="33.390746856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:54:34.281215484 +0000 UTC m=+42.023021826" watchObservedRunningTime="2026-07-21 01:54:55.271472633 +0000 UTC m=+63.013278973"
Jul 21 01:54:57.582575 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.582519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:57.582575 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.582590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:54:57.585666 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.585643    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:54:57.585788 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.585689    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:54:57.593147 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:57.593116    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 01:54:57.593287 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:57.593204    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:56:01.593182767 +0000 UTC m=+129.334989107 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : secret "metrics-daemon-secret" not found
Jul 21 01:54:57.596467 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.596445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5568fc66-bd91-4463-aa4b-d06acc5ee517-original-pull-secret\") pod \"global-pull-secret-syncer-r7st8\" (UID: \"5568fc66-bd91-4463-aa4b-d06acc5ee517\") " pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:57.628722 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.628677    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r7st8"
Jul 21 01:54:57.683484 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.683447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:57.687102 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.687070    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:54:57.696223 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.696199    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:54:57.706644 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.706616    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96t47\" (UniqueName: \"kubernetes.io/projected/95cad266-8439-46ce-a25b-4a24751f5e12-kube-api-access-96t47\") pod \"network-check-target-qm4mp\" (UID: \"95cad266-8439-46ce-a25b-4a24751f5e12\") " pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:57.753710 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.753674    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r7st8"]
Jul 21 01:54:57.756786 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:54:57.756755    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5568fc66_bd91_4463_aa4b_d06acc5ee517.slice/crio-260e883b55b0e9e5e732902f0e79c5fc26afc37b357c8305f2de3102fc8a833c WatchSource:0}: Error finding container 260e883b55b0e9e5e732902f0e79c5fc26afc37b357c8305f2de3102fc8a833c: Status 404 returned error can't find the container with id 260e883b55b0e9e5e732902f0e79c5fc26afc37b357c8305f2de3102fc8a833c
Jul 21 01:54:57.831728 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.831694    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g586n\""
Jul 21 01:54:57.838868 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.838816    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:54:57.960036 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:57.960007    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm4mp"]
Jul 21 01:54:57.963248 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:54:57.963210    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cad266_8439_46ce_a25b_4a24751f5e12.slice/crio-56c2be93ed82e0c3f378260fcd9d024aab3201d9d89e6e00ca5f0bf0e4c09fb9 WatchSource:0}: Error finding container 56c2be93ed82e0c3f378260fcd9d024aab3201d9d89e6e00ca5f0bf0e4c09fb9: Status 404 returned error can't find the container with id 56c2be93ed82e0c3f378260fcd9d024aab3201d9d89e6e00ca5f0bf0e4c09fb9
Jul 21 01:54:58.302256 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:58.302202    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm4mp" event={"ID":"95cad266-8439-46ce-a25b-4a24751f5e12","Type":"ContainerStarted","Data":"56c2be93ed82e0c3f378260fcd9d024aab3201d9d89e6e00ca5f0bf0e4c09fb9"}
Jul 21 01:54:58.303262 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:58.303223    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r7st8" event={"ID":"5568fc66-bd91-4463-aa4b-d06acc5ee517","Type":"ContainerStarted","Data":"260e883b55b0e9e5e732902f0e79c5fc26afc37b357c8305f2de3102fc8a833c"}
Jul 21 01:54:59.897653 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:54:59.897389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:54:59.897653 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:59.897538    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:54:59.897653 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:54:59.897606    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:55:31.897586453 +0000 UTC m=+99.639392775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:55:03.318647 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:03.318598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r7st8" event={"ID":"5568fc66-bd91-4463-aa4b-d06acc5ee517","Type":"ContainerStarted","Data":"4198f202334fc0699b52728eff9cf67322a2e78f431e4a5d82e21d6d7b5205b9"}
Jul 21 01:55:03.319902 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:03.319876    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm4mp" event={"ID":"95cad266-8439-46ce-a25b-4a24751f5e12","Type":"ContainerStarted","Data":"6d8d8cf2208d24905a7ce2e3245c334815495739267b7f157bdd5348ca86cab3"}
Jul 21 01:55:03.320038 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:03.320013    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:55:03.334703 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:03.334650    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r7st8" podStartSLOduration=65.564498658 podStartE2EDuration="1m10.334635144s" totalImagesPullingTime="4.770136486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:55:03.333933972 +0000 UTC m=+71.075740315" watchObservedRunningTime="2026-07-21 01:55:03.334635144 +0000 UTC m=+71.076441490"
Jul 21 01:55:03.347696 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:03.347652    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qm4mp" podStartSLOduration=65.783108729 podStartE2EDuration="1m10.34764182s" totalImagesPullingTime="4.564533091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:55:03.347410021 +0000 UTC m=+71.089216363" watchObservedRunningTime="2026-07-21 01:55:03.34764182 +0000 UTC m=+71.089448162"
Jul 21 01:55:22.576476 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.576439    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"]
Jul 21 01:55:22.579000 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.578983    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.582043 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.582022    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 01:55:22.583511 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.583488    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 01:55:22.583511 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.583503    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 01:55:22.583678 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.583507    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 01:55:22.596575 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.596548    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"]
Jul 21 01:55:22.635645 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.635608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw65p\" (UniqueName: \"kubernetes.io/projected/e00d386a-fd0f-4f78-b639-b79f997df517-kube-api-access-nw65p\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.635645 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.635641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e00d386a-fd0f-4f78-b639-b79f997df517-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.635832 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.635685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e00d386a-fd0f-4f78-b639-b79f997df517-tmp\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.736791 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.736757    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw65p\" (UniqueName: \"kubernetes.io/projected/e00d386a-fd0f-4f78-b639-b79f997df517-kube-api-access-nw65p\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.736791 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.736791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e00d386a-fd0f-4f78-b639-b79f997df517-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.736992 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.736847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e00d386a-fd0f-4f78-b639-b79f997df517-tmp\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.737365 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.737345    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e00d386a-fd0f-4f78-b639-b79f997df517-tmp\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.739445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.739425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e00d386a-fd0f-4f78-b639-b79f997df517-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.744902 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.744878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw65p\" (UniqueName: \"kubernetes.io/projected/e00d386a-fd0f-4f78-b639-b79f997df517-kube-api-access-nw65p\") pod \"klusterlet-addon-workmgr-5cc984d4d4-xrzf4\" (UID: \"e00d386a-fd0f-4f78-b639-b79f997df517\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:22.888595 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:22.888505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:23.008296 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:23.008116    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"]
Jul 21 01:55:23.010828 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:55:23.010793    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00d386a_fd0f_4f78_b639_b79f997df517.slice/crio-f9edf7681a36da955462260664562b927c318c71b423e61f773217f98c333844 WatchSource:0}: Error finding container f9edf7681a36da955462260664562b927c318c71b423e61f773217f98c333844: Status 404 returned error can't find the container with id f9edf7681a36da955462260664562b927c318c71b423e61f773217f98c333844
Jul 21 01:55:23.367820 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:23.367779    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4" event={"ID":"e00d386a-fd0f-4f78-b639-b79f997df517","Type":"ContainerStarted","Data":"f9edf7681a36da955462260664562b927c318c71b423e61f773217f98c333844"}
Jul 21 01:55:28.381456 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:28.381420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4" event={"ID":"e00d386a-fd0f-4f78-b639-b79f997df517","Type":"ContainerStarted","Data":"92dc0a401e9fb1acd0cca652fe7247d2a81ee60dec357b2e0f7e54f50e2f01cf"}
Jul 21 01:55:28.381855 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:28.381623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:28.383279 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:28.383256    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:55:28.400213 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:28.400172    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4" podStartSLOduration=1.8156578049999998 podStartE2EDuration="6.400154093s" totalImagesPullingTime="4.584496288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:55:28.399567671 +0000 UTC m=+96.141374015" watchObservedRunningTime="2026-07-21 01:55:28.400154093 +0000 UTC m=+96.141960436"
Jul 21 01:55:31.903742 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:31.903702    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:55:31.904117 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:55:31.903813    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:55:31.904117 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:55:31.903872    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:56:35.903857886 +0000 UTC m=+163.645664205 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:55:34.324532 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:55:34.324498    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qm4mp"
Jul 21 01:56:01.612063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:56:01.612025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:56:01.612557 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:56:01.612206    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 01:56:01.612557 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:56:01.612318    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:03.612300437 +0000 UTC m=+251.354106756 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : secret "metrics-daemon-secret" not found
Jul 21 01:56:31.078195 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:56:31.078142    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4fw89" podUID="928398f5-9efb-4fe2-9e95-4493538183e9"
Jul 21 01:56:31.538475 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:56:31.538439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4fw89"
Jul 21 01:56:33.034144 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:56:33.034101    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:56:35.946903 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:56:35.946864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:56:35.947337 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:56:35.946993    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:56:35.947337 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:56:35.947053    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls podName:928398f5-9efb-4fe2-9e95-4493538183e9 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:37.94703928 +0000 UTC m=+285.688845598 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls") pod "dns-default-4fw89" (UID: "928398f5-9efb-4fe2-9e95-4493538183e9") : secret "dns-default-metrics-tls" not found
Jul 21 01:56:47.016158 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:56:47.016069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:57:28.382731 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:28.382672    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4" podUID="e00d386a-fd0f-4f78-b639-b79f997df517" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 21 01:57:28.673567 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:28.673486    2574 generic.go:356] "Generic (PLEG): container finished" podID="e00d386a-fd0f-4f78-b639-b79f997df517" containerID="92dc0a401e9fb1acd0cca652fe7247d2a81ee60dec357b2e0f7e54f50e2f01cf" exitCode=1
Jul 21 01:57:28.673567 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:28.673553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4" event={"ID":"e00d386a-fd0f-4f78-b639-b79f997df517","Type":"ContainerDied","Data":"92dc0a401e9fb1acd0cca652fe7247d2a81ee60dec357b2e0f7e54f50e2f01cf"}
Jul 21 01:57:28.673878 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:28.673864    2574 scope.go:117] "RemoveContainer" containerID="92dc0a401e9fb1acd0cca652fe7247d2a81ee60dec357b2e0f7e54f50e2f01cf"
Jul 21 01:57:29.680019 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:29.679979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4" event={"ID":"e00d386a-fd0f-4f78-b639-b79f997df517","Type":"ContainerStarted","Data":"2c9b6b296d89c4ab190626a65d9e886b60ad0c33406ff9b6b37d61908ef476d8"}
Jul 21 01:57:29.680436 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:29.680290    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:57:29.680918 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:57:29.680897    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cc984d4d4-xrzf4"
Jul 21 01:58:03.624909 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:03.624861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:58:03.625431 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:03.624978    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 01:58:03.625431 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:03.625038    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs podName:6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4 nodeName:}" failed. No retries permitted until 2026-07-21 02:00:05.625023517 +0000 UTC m=+373.366829836 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs") pod "network-metrics-daemon-xfkbj" (UID: "6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4") : secret "metrics-daemon-secret" not found
Jul 21 01:58:05.081591 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.081555    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69778848fd-sbjnc"]
Jul 21 01:58:05.084534 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.084508    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.090123 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.086095    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5b65dd99-78mf8"]
Jul 21 01:58:05.090123 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.089445    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 01:58:05.090123 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.089454    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 01:58:05.090123 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.089955    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 01:58:05.090416 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.090090    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 01:58:05.090416 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.090267    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-db7xd\""
Jul 21 01:58:05.090705 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.090677    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 01:58:05.090936 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.090922    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 01:58:05.092448 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.092430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.094925 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.094908    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 01:58:05.095197 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.095181    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 01:58:05.095499 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.095482    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8zlf\""
Jul 21 01:58:05.095582 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.095536    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 01:58:05.098851 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.098830    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69778848fd-sbjnc"]
Jul 21 01:58:05.101449 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.101430    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 01:58:05.101853 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.101832    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5b65dd99-78mf8"]
Jul 21 01:58:05.135505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-image-registry-private-configuration\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135510    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-trusted-ca\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135530    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-bound-sa-token\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bk48\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-kube-api-access-8bk48\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af316bb2-4344-4694-8466-83fca311b677-ca-trust-extracted\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-stats-auth\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl74k\" (UniqueName: \"kubernetes.io/projected/f7ef1d90-623b-49cf-92d0-7d85ca88d545-kube-api-access-kl74k\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-registry-certificates\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135997 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135752    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-installation-pull-secrets\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.135997 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.135997 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-default-certificate\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.135997 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.135845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.180427 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.180375    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-55b6r"]
Jul 21 01:58:05.183369 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.183350    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jzr2d"]
Jul 21 01:58:05.183508 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.183491    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.186201 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.186171    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 01:58:05.186201 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.186186    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.186201 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.186173    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:58:05.186714 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.186695    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 01:58:05.187003 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.186989    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 01:58:05.187523 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.187509    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g6qn5\""
Jul 21 01:58:05.189690 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.189672    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 01:58:05.190029 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.189806    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dsx4r\""
Jul 21 01:58:05.190121 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.190009    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 01:58:05.190658 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.190636    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 01:58:05.191328 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.191310    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 01:58:05.194039 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.194011    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 01:58:05.195651 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.195636    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 01:58:05.199369 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.199351    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-55b6r"]
Jul 21 01:58:05.200533 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.200511    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jzr2d"]
Jul 21 01:58:05.237025 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.236994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmwx\" (UniqueName: \"kubernetes.io/projected/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-kube-api-access-qcmwx\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.237025 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af316bb2-4344-4694-8466-83fca311b677-ca-trust-extracted\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-stats-auth\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.237150    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.237162    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5b65dd99-78mf8: secret "image-registry-tls" not found
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.237213    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls podName:af316bb2-4344-4694-8466-83fca311b677 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:05.73719548 +0000 UTC m=+253.479001799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls") pod "image-registry-5d5b65dd99-78mf8" (UID: "af316bb2-4344-4694-8466-83fca311b677") : secret "image-registry-tls" not found
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237226    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-registry-certificates\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237262    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-installation-pull-secrets\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.237316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-serving-cert\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19affe16-d907-4db5-8431-8f79c72b7ad9-snapshots\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19affe16-d907-4db5-8431-8f79c72b7ad9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237477    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-trusted-ca\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237495    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-config\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpst5\" (UniqueName: \"kubernetes.io/projected/19affe16-d907-4db5-8431-8f79c72b7ad9-kube-api-access-gpst5\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237573    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af316bb2-4344-4694-8466-83fca311b677-ca-trust-extracted\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.237712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-bound-sa-token\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.237737    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:05.737717533 +0000 UTC m=+253.479523869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : configmap references non-existent config key: service-ca.crt
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237785    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19affe16-d907-4db5-8431-8f79c72b7ad9-tmp\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl74k\" (UniqueName: \"kubernetes.io/projected/f7ef1d90-623b-49cf-92d0-7d85ca88d545-kube-api-access-kl74k\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237894    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-default-certificate\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-registry-certificates\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.237983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19affe16-d907-4db5-8431-8f79c72b7ad9-service-ca-bundle\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.238104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.238101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-image-registry-private-configuration\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.238598 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.238176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-trusted-ca\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.238598 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.238261    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 01:58:05.238598 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.238268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19affe16-d907-4db5-8431-8f79c72b7ad9-serving-cert\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.238598 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.238316    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:05.738299119 +0000 UTC m=+253.480105441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : secret "router-metrics-certs-default" not found
Jul 21 01:58:05.238598 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.238305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bk48\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-kube-api-access-8bk48\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.239034 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.239009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-trusted-ca\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.240041 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.240015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-installation-pull-secrets\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.240291 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.240051    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-stats-auth\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.240370 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.240336    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-default-certificate\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.240561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.240541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-image-registry-private-configuration\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.245626 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.245600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-bound-sa-token\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.246562 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.246542    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl74k\" (UniqueName: \"kubernetes.io/projected/f7ef1d90-623b-49cf-92d0-7d85ca88d545-kube-api-access-kl74k\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.246963 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.246943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bk48\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-kube-api-access-8bk48\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.339229 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19affe16-d907-4db5-8431-8f79c72b7ad9-service-ca-bundle\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.339229 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-trusted-ca\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.339482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19affe16-d907-4db5-8431-8f79c72b7ad9-serving-cert\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.339482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmwx\" (UniqueName: \"kubernetes.io/projected/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-kube-api-access-qcmwx\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.339482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-serving-cert\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.339482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19affe16-d907-4db5-8431-8f79c72b7ad9-snapshots\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.339482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19affe16-d907-4db5-8431-8f79c72b7ad9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.339703 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-config\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.339703 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpst5\" (UniqueName: \"kubernetes.io/projected/19affe16-d907-4db5-8431-8f79c72b7ad9-kube-api-access-gpst5\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.339703 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.339595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19affe16-d907-4db5-8431-8f79c72b7ad9-tmp\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.340635 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.340604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19affe16-d907-4db5-8431-8f79c72b7ad9-tmp\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.340884 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.340856    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19affe16-d907-4db5-8431-8f79c72b7ad9-service-ca-bundle\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.340991 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.340869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19affe16-d907-4db5-8431-8f79c72b7ad9-snapshots\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.341052 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.341025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-trusted-ca\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.341228 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.341203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19affe16-d907-4db5-8431-8f79c72b7ad9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.341346 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.341328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-config\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.342037 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.342008    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19affe16-d907-4db5-8431-8f79c72b7ad9-serving-cert\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.342119 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.342067    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-serving-cert\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.348487 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.348465    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpst5\" (UniqueName: \"kubernetes.io/projected/19affe16-d907-4db5-8431-8f79c72b7ad9-kube-api-access-gpst5\") pod \"insights-operator-555d9d7885-jzr2d\" (UID: \"19affe16-d907-4db5-8431-8f79c72b7ad9\") " pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.349014 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.348993    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmwx\" (UniqueName: \"kubernetes.io/projected/ef8eddcb-07b1-4bc7-8582-5d5df19edf5e-kube-api-access-qcmwx\") pod \"console-operator-565b7b569d-55b6r\" (UID: \"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e\") " pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.493084 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.493044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:05.500148 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.499637    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jzr2d"
Jul 21 01:58:05.626003 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.625972    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-55b6r"]
Jul 21 01:58:05.629602 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:05.629573    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8eddcb_07b1_4bc7_8582_5d5df19edf5e.slice/crio-472fcd6d11122f5fbe6e12277baf075a3dab677ccfed5f85eebb97ec0ce45f0f WatchSource:0}: Error finding container 472fcd6d11122f5fbe6e12277baf075a3dab677ccfed5f85eebb97ec0ce45f0f: Status 404 returned error can't find the container with id 472fcd6d11122f5fbe6e12277baf075a3dab677ccfed5f85eebb97ec0ce45f0f
Jul 21 01:58:05.644957 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.644930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jzr2d"]
Jul 21 01:58:05.648025 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:05.648000    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19affe16_d907_4db5_8431_8f79c72b7ad9.slice/crio-81ffdba9c755eeed67b00023d29bb1e7a6ba8405e52b5327603ea421645f3d30 WatchSource:0}: Error finding container 81ffdba9c755eeed67b00023d29bb1e7a6ba8405e52b5327603ea421645f3d30: Status 404 returned error can't find the container with id 81ffdba9c755eeed67b00023d29bb1e7a6ba8405e52b5327603ea421645f3d30
Jul 21 01:58:05.743861 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.743815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.743871    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.743920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.743944    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:06.743925522 +0000 UTC m=+254.485731841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : secret "router-metrics-certs-default" not found
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.744001    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.744015    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5b65dd99-78mf8: secret "image-registry-tls" not found
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.744032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:05.744061 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.744060    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls podName:af316bb2-4344-4694-8466-83fca311b677 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:06.744045922 +0000 UTC m=+254.485852251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls") pod "image-registry-5d5b65dd99-78mf8" (UID: "af316bb2-4344-4694-8466-83fca311b677") : secret "image-registry-tls" not found
Jul 21 01:58:05.744354 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:05.744113    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:06.744098956 +0000 UTC m=+254.485905288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : configmap references non-existent config key: service-ca.crt
Jul 21 01:58:05.779554 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.779516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jzr2d" event={"ID":"19affe16-d907-4db5-8431-8f79c72b7ad9","Type":"ContainerStarted","Data":"81ffdba9c755eeed67b00023d29bb1e7a6ba8405e52b5327603ea421645f3d30"}
Jul 21 01:58:05.780520 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:05.780487    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" event={"ID":"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e","Type":"ContainerStarted","Data":"472fcd6d11122f5fbe6e12277baf075a3dab677ccfed5f85eebb97ec0ce45f0f"}
Jul 21 01:58:06.752081 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:06.752028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:06.752124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:06.752164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:06.752207    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:06.752248    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5b65dd99-78mf8: secret "image-registry-tls" not found
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:06.752278    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:06.752313    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:08.752296253 +0000 UTC m=+256.494102572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : configmap references non-existent config key: service-ca.crt
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:06.752340    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls podName:af316bb2-4344-4694-8466-83fca311b677 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:08.752328482 +0000 UTC m=+256.494134802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls") pod "image-registry-5d5b65dd99-78mf8" (UID: "af316bb2-4344-4694-8466-83fca311b677") : secret "image-registry-tls" not found
Jul 21 01:58:06.752600 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:06.752355    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:08.752346768 +0000 UTC m=+256.494153089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : secret "router-metrics-certs-default" not found
Jul 21 01:58:08.770186 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.770155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.770242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.770292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:08.770368    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:08.770373    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:08.770426    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:12.770407553 +0000 UTC m=+260.512213895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : secret "router-metrics-certs-default" not found
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:08.770436    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5b65dd99-78mf8: secret "image-registry-tls" not found
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:08.770444    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:12.770435262 +0000 UTC m=+260.512241582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : configmap references non-existent config key: service-ca.crt
Jul 21 01:58:08.770623 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:08.770493    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls podName:af316bb2-4344-4694-8466-83fca311b677 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:12.770475078 +0000 UTC m=+260.512281424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls") pod "image-registry-5d5b65dd99-78mf8" (UID: "af316bb2-4344-4694-8466-83fca311b677") : secret "image-registry-tls" not found
Jul 21 01:58:08.791446 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.791402    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jzr2d" event={"ID":"19affe16-d907-4db5-8431-8f79c72b7ad9","Type":"ContainerStarted","Data":"6351b5b4bbd6a8474cec6f96c65e9475334a3c8d76aa0bdd2cf443bf40638d88"}
Jul 21 01:58:08.793102 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.793083    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/0.log"
Jul 21 01:58:08.793211 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.793120    2574 generic.go:356] "Generic (PLEG): container finished" podID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e" containerID="d80a2587a7c78ace1a2cafd7a94437d9b3482cf831004ea6e740e57047d41b35" exitCode=255
Jul 21 01:58:08.793211 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.793181    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" event={"ID":"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e","Type":"ContainerDied","Data":"d80a2587a7c78ace1a2cafd7a94437d9b3482cf831004ea6e740e57047d41b35"}
Jul 21 01:58:08.793394 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.793381    2574 scope.go:117] "RemoveContainer" containerID="d80a2587a7c78ace1a2cafd7a94437d9b3482cf831004ea6e740e57047d41b35"
Jul 21 01:58:08.809206 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:08.809164    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-jzr2d" podStartSLOduration=1.21520994 podStartE2EDuration="3.809147063s" totalImagesPullingTime="2.593937123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:08.807783865 +0000 UTC m=+256.549590205" watchObservedRunningTime="2026-07-21 01:58:08.809147063 +0000 UTC m=+256.550953408"
Jul 21 01:58:09.799457 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.799423    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/1.log"
Jul 21 01:58:09.800020 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.799996    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/0.log"
Jul 21 01:58:09.800159 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.800045    2574 generic.go:356] "Generic (PLEG): container finished" podID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e" containerID="94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9" exitCode=255
Jul 21 01:58:09.800227 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.800139    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" event={"ID":"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e","Type":"ContainerDied","Data":"94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9"}
Jul 21 01:58:09.800322 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.800268    2574 scope.go:117] "RemoveContainer" containerID="d80a2587a7c78ace1a2cafd7a94437d9b3482cf831004ea6e740e57047d41b35"
Jul 21 01:58:09.800545 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.800501    2574 scope.go:117] "RemoveContainer" containerID="94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9"
Jul 21 01:58:09.800733 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:09.800708    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-55b6r_openshift-console-operator(ef8eddcb-07b1-4bc7-8582-5d5df19edf5e)\"" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podUID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e"
Jul 21 01:58:09.809457 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.809433    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7xsbz"]
Jul 21 01:58:09.812754 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.812737    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.815457 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.815438    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 01:58:09.815569 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.815520    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pr29z\""
Jul 21 01:58:09.815569 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.815539    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 01:58:09.824026 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.823999    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7xsbz"]
Jul 21 01:58:09.879381 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.879345    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/236124bb-f4fe-4899-a8f1-4c8be275ba61-data-volume\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.879568 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.879386    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.879568 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.879524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/236124bb-f4fe-4899-a8f1-4c8be275ba61-crio-socket\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.879729 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.879703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.879825 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.879761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzrfp\" (UniqueName: \"kubernetes.io/projected/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-api-access-dzrfp\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981106 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/236124bb-f4fe-4899-a8f1-4c8be275ba61-data-volume\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981106 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/236124bb-f4fe-4899-a8f1-4c8be275ba61-crio-socket\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzrfp\" (UniqueName: \"kubernetes.io/projected/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-api-access-dzrfp\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:09.981214    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:09.981324    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:10.48130327 +0000 UTC m=+258.223109609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : configmap "kube-rbac-proxy" not found
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/236124bb-f4fe-4899-a8f1-4c8be275ba61-crio-socket\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.981374 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:09.981360    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:09.981650 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:09.981429    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:10.481407842 +0000 UTC m=+258.223214178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:09.981650 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.981463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/236124bb-f4fe-4899-a8f1-4c8be275ba61-data-volume\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:09.991467 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:09.991437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzrfp\" (UniqueName: \"kubernetes.io/projected/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-api-access-dzrfp\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:10.486082 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:10.486042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:10.486253 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:10.486122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:10.486253 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:10.486181    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:58:10.486345 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:10.486274    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:11.486255689 +0000 UTC m=+259.228062013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : configmap "kube-rbac-proxy" not found
Jul 21 01:58:10.486345 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:10.486285    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:10.486345 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:10.486332    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:11.486318942 +0000 UTC m=+259.228125265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:10.805098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:10.805026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/1.log"
Jul 21 01:58:10.805461 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:10.805361    2574 scope.go:117] "RemoveContainer" containerID="94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9"
Jul 21 01:58:10.805539 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:10.805519    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-55b6r_openshift-console-operator(ef8eddcb-07b1-4bc7-8582-5d5df19edf5e)\"" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podUID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e"
Jul 21 01:58:11.495019 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.494982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:11.495195 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.495142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:11.495195 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:11.495142    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:11.495293 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:11.495217    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:13.495200844 +0000 UTC m=+261.237007166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:11.495293 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:11.495272    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:58:11.495366 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:11.495335    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:13.49532 +0000 UTC m=+261.237126321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : configmap "kube-rbac-proxy" not found
Jul 21 01:58:11.815325 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.815250    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-rc7zx"]
Jul 21 01:58:11.819358 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.819339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.822018 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.821970    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 01:58:11.823208 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.823183    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 01:58:11.823330 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.823222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r666q\""
Jul 21 01:58:11.823330 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.823283    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 01:58:11.823453 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.823287    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 01:58:11.830785 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.830758    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-rc7zx"]
Jul 21 01:58:11.898216 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.898173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12ea27ad-6201-497d-b48b-9bb65f63905a-signing-key\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.898419 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.898255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmsf\" (UniqueName: \"kubernetes.io/projected/12ea27ad-6201-497d-b48b-9bb65f63905a-kube-api-access-nlmsf\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.898419 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.898343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12ea27ad-6201-497d-b48b-9bb65f63905a-signing-cabundle\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.998918 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.998878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12ea27ad-6201-497d-b48b-9bb65f63905a-signing-key\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.998918 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.998926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmsf\" (UniqueName: \"kubernetes.io/projected/12ea27ad-6201-497d-b48b-9bb65f63905a-kube-api-access-nlmsf\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.999111 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.998956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12ea27ad-6201-497d-b48b-9bb65f63905a-signing-cabundle\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:11.999611 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:11.999589    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12ea27ad-6201-497d-b48b-9bb65f63905a-signing-cabundle\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:12.001325 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.001293    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12ea27ad-6201-497d-b48b-9bb65f63905a-signing-key\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:12.007535 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.007510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmsf\" (UniqueName: \"kubernetes.io/projected/12ea27ad-6201-497d-b48b-9bb65f63905a-kube-api-access-nlmsf\") pod \"service-ca-58598695f7-rc7zx\" (UID: \"12ea27ad-6201-497d-b48b-9bb65f63905a\") " pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:12.129515 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.129425    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-rc7zx"
Jul 21 01:58:12.252482 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.252448    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-rc7zx"]
Jul 21 01:58:12.255491 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:12.255461    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ea27ad_6201_497d_b48b_9bb65f63905a.slice/crio-9ceeeb673c8c5102674c8dbf8f43dcdf2e7328ea68f8826c9b625fa14439d2af WatchSource:0}: Error finding container 9ceeeb673c8c5102674c8dbf8f43dcdf2e7328ea68f8826c9b625fa14439d2af: Status 404 returned error can't find the container with id 9ceeeb673c8c5102674c8dbf8f43dcdf2e7328ea68f8826c9b625fa14439d2af
Jul 21 01:58:12.389408 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.389330    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9vvff_117814c7-fce9-4cd1-be4c-6763b7bc01f7/dns-node-resolver/0.log"
Jul 21 01:58:12.807889 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.807849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:12.808067 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.807911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:12.808067 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.807968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:12.808067 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:12.808049    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:20.808026791 +0000 UTC m=+268.549833126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : configmap references non-existent config key: service-ca.crt
Jul 21 01:58:12.808271 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:12.808098    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:58:12.808271 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:12.808105    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 01:58:12.808271 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:12.808170    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:20.808152627 +0000 UTC m=+268.549958950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : secret "router-metrics-certs-default" not found
Jul 21 01:58:12.808271 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:12.808113    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5b65dd99-78mf8: secret "image-registry-tls" not found
Jul 21 01:58:12.808271 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:12.808221    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls podName:af316bb2-4344-4694-8466-83fca311b677 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:20.808210933 +0000 UTC m=+268.550017255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls") pod "image-registry-5d5b65dd99-78mf8" (UID: "af316bb2-4344-4694-8466-83fca311b677") : secret "image-registry-tls" not found
Jul 21 01:58:12.812457 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:12.812428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-rc7zx" event={"ID":"12ea27ad-6201-497d-b48b-9bb65f63905a","Type":"ContainerStarted","Data":"9ceeeb673c8c5102674c8dbf8f43dcdf2e7328ea68f8826c9b625fa14439d2af"}
Jul 21 01:58:13.387929 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:13.387902    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8549s_9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42/node-ca/0.log"
Jul 21 01:58:13.514656 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:13.514619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:13.514850 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:13.514717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:13.514850 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:13.514757    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:58:13.514850 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:13.514841    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:17.514821334 +0000 UTC m=+265.256627653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : configmap "kube-rbac-proxy" not found
Jul 21 01:58:13.514995 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:13.514880    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:13.514995 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:13.514966    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:17.514949161 +0000 UTC m=+265.256755480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:14.187807 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:14.187772    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cpswz_9e26a01e-f32f-4d79-9b03-115e2e69d208/serve-healthcheck-canary/0.log"
Jul 21 01:58:14.820602 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:14.820564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-rc7zx" event={"ID":"12ea27ad-6201-497d-b48b-9bb65f63905a","Type":"ContainerStarted","Data":"b0f3305a0def0ed1c06e66ab67a09f4e0b56b3c381a0fa40c35ffc83a4d3188e"}
Jul 21 01:58:14.836681 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:14.836631    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-rc7zx" podStartSLOduration=2.014706469 podStartE2EDuration="3.83661529s" totalImagesPullingTime="1.821908821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:14.834968653 +0000 UTC m=+262.576774996" watchObservedRunningTime="2026-07-21 01:58:14.83661529 +0000 UTC m=+262.578421676"
Jul 21 01:58:15.493381 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:15.493349    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:15.493569 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:15.493412    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:15.493822 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:15.493805    2574 scope.go:117] "RemoveContainer" containerID="94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9"
Jul 21 01:58:15.494018 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:15.493996    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-55b6r_openshift-console-operator(ef8eddcb-07b1-4bc7-8582-5d5df19edf5e)\"" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podUID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e"
Jul 21 01:58:17.550811 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:17.550778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:17.551189 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:17.550847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:17.551189 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:17.550914    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:58:17.551189 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:17.550970    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:17.551189 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:17.550996    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:25.55097489 +0000 UTC m=+273.292781212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : configmap "kube-rbac-proxy" not found
Jul 21 01:58:17.551189 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:17.551016    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls podName:236124bb-f4fe-4899-a8f1-4c8be275ba61 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:25.551006812 +0000 UTC m=+273.292813138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7xsbz" (UID: "236124bb-f4fe-4899-a8f1-4c8be275ba61") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:58:20.884028 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:20.883986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:20.884531 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:20.884091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:20.884531 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:20.884153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:20.884531 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:20.884326    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle podName:f7ef1d90-623b-49cf-92d0-7d85ca88d545 nodeName:}" failed. No retries permitted until 2026-07-21 01:58:36.884302185 +0000 UTC m=+284.626108517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle") pod "router-default-69778848fd-sbjnc" (UID: "f7ef1d90-623b-49cf-92d0-7d85ca88d545") : configmap references non-existent config key: service-ca.crt
Jul 21 01:58:20.886608 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:20.886574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"image-registry-5d5b65dd99-78mf8\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") " pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:20.886852 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:20.886834    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7ef1d90-623b-49cf-92d0-7d85ca88d545-metrics-certs\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:21.004338 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:21.004298    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:21.136981 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:21.136961    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5b65dd99-78mf8"]
Jul 21 01:58:21.139661 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:21.139633    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf316bb2_4344_4694_8466_83fca311b677.slice/crio-9e303b47ba16607c03fe8b02fc4ee1522002c19ae23820bdbc03dd26201e0421 WatchSource:0}: Error finding container 9e303b47ba16607c03fe8b02fc4ee1522002c19ae23820bdbc03dd26201e0421: Status 404 returned error can't find the container with id 9e303b47ba16607c03fe8b02fc4ee1522002c19ae23820bdbc03dd26201e0421
Jul 21 01:58:21.842661 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:21.842628    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" event={"ID":"af316bb2-4344-4694-8466-83fca311b677","Type":"ContainerStarted","Data":"94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79"}
Jul 21 01:58:21.842843 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:21.842676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" event={"ID":"af316bb2-4344-4694-8466-83fca311b677","Type":"ContainerStarted","Data":"9e303b47ba16607c03fe8b02fc4ee1522002c19ae23820bdbc03dd26201e0421"}
Jul 21 01:58:21.842843 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:21.842743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:21.862759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:21.862712    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" podStartSLOduration=16.862698292 podStartE2EDuration="16.862698292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:21.862101053 +0000 UTC m=+269.603907386" watchObservedRunningTime="2026-07-21 01:58:21.862698292 +0000 UTC m=+269.604504633"
Jul 21 01:58:25.625741 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.625703    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:25.626099 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.625783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:25.626310 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.626286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/236124bb-f4fe-4899-a8f1-4c8be275ba61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:25.628014 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.627989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/236124bb-f4fe-4899-a8f1-4c8be275ba61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xsbz\" (UID: \"236124bb-f4fe-4899-a8f1-4c8be275ba61\") " pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:25.722187 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.722153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7xsbz"
Jul 21 01:58:25.846868 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.846839    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7xsbz"]
Jul 21 01:58:25.849503 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:25.849480    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236124bb_f4fe_4899_a8f1_4c8be275ba61.slice/crio-e1a79c5547a75ad34b8eef7d29b1813bc43d7a45c3b9c30ac7bcbf19bb725012 WatchSource:0}: Error finding container e1a79c5547a75ad34b8eef7d29b1813bc43d7a45c3b9c30ac7bcbf19bb725012: Status 404 returned error can't find the container with id e1a79c5547a75ad34b8eef7d29b1813bc43d7a45c3b9c30ac7bcbf19bb725012
Jul 21 01:58:25.854574 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:25.854548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xsbz" event={"ID":"236124bb-f4fe-4899-a8f1-4c8be275ba61","Type":"ContainerStarted","Data":"e1a79c5547a75ad34b8eef7d29b1813bc43d7a45c3b9c30ac7bcbf19bb725012"}
Jul 21 01:58:30.874960 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:30.874878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xsbz" event={"ID":"236124bb-f4fe-4899-a8f1-4c8be275ba61","Type":"ContainerStarted","Data":"8bb61a9f1b034bf489f323529fd35c38005f418371813899af05b7d6928f00f8"}
Jul 21 01:58:31.016680 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.016646    2574 scope.go:117] "RemoveContainer" containerID="94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9"
Jul 21 01:58:31.880154 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.880126    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 01:58:31.880613 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.880596    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/1.log"
Jul 21 01:58:31.880702 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.880649    2574 generic.go:356] "Generic (PLEG): container finished" podID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e" containerID="21ca270682fe98d44959c4b3af4d36f1ab8d3095cc35ee0c727202c5d82f09cc" exitCode=255
Jul 21 01:58:31.880746 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.880711    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" event={"ID":"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e","Type":"ContainerDied","Data":"21ca270682fe98d44959c4b3af4d36f1ab8d3095cc35ee0c727202c5d82f09cc"}
Jul 21 01:58:31.880791 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.880775    2574 scope.go:117] "RemoveContainer" containerID="94661b1cb788a50e94d5e3f022b8c3f49c6f57820ca5b9a26d2a05fbf53375d9"
Jul 21 01:58:31.881104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:31.881087    2574 scope.go:117] "RemoveContainer" containerID="21ca270682fe98d44959c4b3af4d36f1ab8d3095cc35ee0c727202c5d82f09cc"
Jul 21 01:58:31.881332 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:31.881304    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-55b6r_openshift-console-operator(ef8eddcb-07b1-4bc7-8582-5d5df19edf5e)\"" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podUID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e"
Jul 21 01:58:32.885424 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:32.885390    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 01:58:33.624106 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:33.624066    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d5b65dd99-78mf8"]
Jul 21 01:58:34.539426 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:34.539380    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4fw89" podUID="928398f5-9efb-4fe2-9e95-4493538183e9"
Jul 21 01:58:34.893810 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:34.893738    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4fw89"
Jul 21 01:58:34.893810 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:34.893735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xsbz" event={"ID":"236124bb-f4fe-4899-a8f1-4c8be275ba61","Type":"ContainerStarted","Data":"d40be94485d32f20d07bdcedee1eb477d9f991c413f42128e2835637876433a8"}
Jul 21 01:58:35.493903 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:35.493865    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:35.494098 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:35.493943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:58:35.494380 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:35.494363    2574 scope.go:117] "RemoveContainer" containerID="21ca270682fe98d44959c4b3af4d36f1ab8d3095cc35ee0c727202c5d82f09cc"
Jul 21 01:58:35.494582 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:35.494558    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-55b6r_openshift-console-operator(ef8eddcb-07b1-4bc7-8582-5d5df19edf5e)\"" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podUID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e"
Jul 21 01:58:36.923899 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:36.923859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:36.924575 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:36.924551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ef1d90-623b-49cf-92d0-7d85ca88d545-service-ca-bundle\") pod \"router-default-69778848fd-sbjnc\" (UID: \"f7ef1d90-623b-49cf-92d0-7d85ca88d545\") " pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:37.197479 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.197384    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:37.508654 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.508627    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69778848fd-sbjnc"]
Jul 21 01:58:37.511661 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:37.511631    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ef1d90_623b_49cf_92d0_7d85ca88d545.slice/crio-a69431b3c4e5b6155ccaea0b281386e4adc8fc2ba0b1df89e5756059f046167e WatchSource:0}: Error finding container a69431b3c4e5b6155ccaea0b281386e4adc8fc2ba0b1df89e5756059f046167e: Status 404 returned error can't find the container with id a69431b3c4e5b6155ccaea0b281386e4adc8fc2ba0b1df89e5756059f046167e
Jul 21 01:58:37.905250 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.905192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xsbz" event={"ID":"236124bb-f4fe-4899-a8f1-4c8be275ba61","Type":"ContainerStarted","Data":"a66174945bbfb995c7e2f8cf7ed425736a8eaab515256b88c578f30b56cc4139"}
Jul 21 01:58:37.906596 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.906570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69778848fd-sbjnc" event={"ID":"f7ef1d90-623b-49cf-92d0-7d85ca88d545","Type":"ContainerStarted","Data":"e18d6f2108fd20c9859e15e129ddabff944dd33d274f8a11c5d97f171faa5788"}
Jul 21 01:58:37.906736 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.906608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69778848fd-sbjnc" event={"ID":"f7ef1d90-623b-49cf-92d0-7d85ca88d545","Type":"ContainerStarted","Data":"a69431b3c4e5b6155ccaea0b281386e4adc8fc2ba0b1df89e5756059f046167e"}
Jul 21 01:58:37.925359 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.925314    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7xsbz" podStartSLOduration=17.464195296 podStartE2EDuration="28.925299307s" totalImagesPullingTime="11.461104011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:58:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:37.923823086 +0000 UTC m=+285.665629479" watchObservedRunningTime="2026-07-21 01:58:37.925299307 +0000 UTC m=+285.667105647"
Jul 21 01:58:37.941139 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:37.941096    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69778848fd-sbjnc" podStartSLOduration=32.941080636 podStartE2EDuration="32.941080636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:37.939979867 +0000 UTC m=+285.681786207" watchObservedRunningTime="2026-07-21 01:58:37.941080636 +0000 UTC m=+285.682886977"
Jul 21 01:58:38.032869 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.032827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:58:38.035142 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.035116    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/928398f5-9efb-4fe2-9e95-4493538183e9-metrics-tls\") pod \"dns-default-4fw89\" (UID: \"928398f5-9efb-4fe2-9e95-4493538183e9\") " pod="openshift-dns/dns-default-4fw89"
Jul 21 01:58:38.197554 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.197478    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cbx74\""
Jul 21 01:58:38.197714 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.197566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:38.200212 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.200190    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:38.205484 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.205467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4fw89"
Jul 21 01:58:38.331040 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.330690    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4fw89"]
Jul 21 01:58:38.333293 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:38.333269    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928398f5_9efb_4fe2_9e95_4493538183e9.slice/crio-fbc299c88e06d5803e482467cb5d87399cf12ce6ead5fb6023e8c206fa8e4e5d WatchSource:0}: Error finding container fbc299c88e06d5803e482467cb5d87399cf12ce6ead5fb6023e8c206fa8e4e5d: Status 404 returned error can't find the container with id fbc299c88e06d5803e482467cb5d87399cf12ce6ead5fb6023e8c206fa8e4e5d
Jul 21 01:58:38.913916 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.913878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4fw89" event={"ID":"928398f5-9efb-4fe2-9e95-4493538183e9","Type":"ContainerStarted","Data":"fbc299c88e06d5803e482467cb5d87399cf12ce6ead5fb6023e8c206fa8e4e5d"}
Jul 21 01:58:38.914271 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.914249    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:38.915429 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:38.915403    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69778848fd-sbjnc"
Jul 21 01:58:40.923146 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:40.923105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4fw89" event={"ID":"928398f5-9efb-4fe2-9e95-4493538183e9","Type":"ContainerStarted","Data":"38811398790a6df9930fd0fe94b668ec65ff4d81796d63fa55ba748262ee14ce"}
Jul 21 01:58:40.923588 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:40.923168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4fw89" event={"ID":"928398f5-9efb-4fe2-9e95-4493538183e9","Type":"ContainerStarted","Data":"246c307f0f5e01364cefe2cbeba120d45ea4a2e204094720519c56c2fc4a6bdf"}
Jul 21 01:58:40.923588 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:40.923322    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4fw89"
Jul 21 01:58:40.941485 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:40.941437    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4fw89" podStartSLOduration=251.068692619 podStartE2EDuration="4m12.941421775s" totalImagesPullingTime="1.872729156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:40.940102655 +0000 UTC m=+288.681908996" watchObservedRunningTime="2026-07-21 01:58:40.941421775 +0000 UTC m=+288.683228110"
Jul 21 01:58:43.630210 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:43.630157    2574 patch_prober.go:28] interesting pod/image-registry-5d5b65dd99-78mf8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 01:58:43.630630 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:43.630261    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" podUID="af316bb2-4344-4694-8466-83fca311b677" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 01:58:48.016221 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:48.016191    2574 scope.go:117] "RemoveContainer" containerID="21ca270682fe98d44959c4b3af4d36f1ab8d3095cc35ee0c727202c5d82f09cc"
Jul 21 01:58:48.016714 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:48.016371    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-55b6r_openshift-console-operator(ef8eddcb-07b1-4bc7-8582-5d5df19edf5e)\"" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podUID="ef8eddcb-07b1-4bc7-8582-5d5df19edf5e"
Jul 21 01:58:48.999627 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:48.998278    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"]
Jul 21 01:58:49.159484 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.159443    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zptjp"]
Jul 21 01:58:49.159484 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.159481    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.162421 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.162383    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 01:58:49.162421 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.162390    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 01:58:49.162644 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.162441    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 01:58:49.163605 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.163573    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 01:58:49.163792 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.163779    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 01:58:49.163886 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.163869    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mct7f\""
Jul 21 01:58:49.181324 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.181297    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.183946 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.183926    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 01:58:49.184067 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.183976    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 01:58:49.184183 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.184162    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t5p5s\""
Jul 21 01:58:49.184369 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.184348    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 01:58:49.185732 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.185715    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"]
Jul 21 01:58:49.185816 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.185761    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"]
Jul 21 01:58:49.207347 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.207324    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"]
Jul 21 01:58:49.207459 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.207430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.210120 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.210099    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7cvjl\""
Jul 21 01:58:49.210255 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.210151    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 01:58:49.210255 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.210193    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 01:58:49.210488 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.210473    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 01:58:49.215511 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f011eba4-1f12-402c-9516-242892c1f187-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.215617 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bb4c15-e30e-4c36-a026-f4af21128e66-metrics-client-ca\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215617 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdnr\" (UniqueName: \"kubernetes.io/projected/75bb4c15-e30e-4c36-a026-f4af21128e66-kube-api-access-dhdnr\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215617 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f011eba4-1f12-402c-9516-242892c1f187-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.215617 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215602    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-wtmp\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215660    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-sys\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f011eba4-1f12-402c-9516-242892c1f187-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.215758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-tls\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-accelerators-collector-config\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215937 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-root\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215937 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.215937 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kflch\" (UniqueName: \"kubernetes.io/projected/f011eba4-1f12-402c-9516-242892c1f187-kube-api-access-kflch\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.215937 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.215862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-textfile\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.316527 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.316527 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kflch\" (UniqueName: \"kubernetes.io/projected/f011eba4-1f12-402c-9516-242892c1f187-kube-api-access-kflch\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.316527 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-textfile\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f011eba4-1f12-402c-9516-242892c1f187-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bb4c15-e30e-4c36-a026-f4af21128e66-metrics-client-ca\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdnr\" (UniqueName: \"kubernetes.io/projected/75bb4c15-e30e-4c36-a026-f4af21128e66-kube-api-access-dhdnr\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.316759 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316732    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.317063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f011eba4-1f12-402c-9516-242892c1f187-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.317063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-wtmp\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.317063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-sys\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.316946    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-textfile\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f011eba4-1f12-402c-9516-242892c1f187-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-tls\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-sys\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-wtmp\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6qc\" (UniqueName: \"kubernetes.io/projected/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-api-access-gn6qc\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-accelerators-collector-config\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-root\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75bb4c15-e30e-4c36-a026-f4af21128e66-root\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317578 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f011eba4-1f12-402c-9516-242892c1f187-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.317971 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317815    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-accelerators-collector-config\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.317971 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.317898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bb4c15-e30e-4c36-a026-f4af21128e66-metrics-client-ca\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.319079 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.319059    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.319679 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.319659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f011eba4-1f12-402c-9516-242892c1f187-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.319758 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.319692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f011eba4-1f12-402c-9516-242892c1f187-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.319891 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.319875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75bb4c15-e30e-4c36-a026-f4af21128e66-node-exporter-tls\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.324673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.324647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdnr\" (UniqueName: \"kubernetes.io/projected/75bb4c15-e30e-4c36-a026-f4af21128e66-kube-api-access-dhdnr\") pod \"node-exporter-zptjp\" (UID: \"75bb4c15-e30e-4c36-a026-f4af21128e66\") " pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.324673 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.324671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kflch\" (UniqueName: \"kubernetes.io/projected/f011eba4-1f12-402c-9516-242892c1f187-kube-api-access-kflch\") pod \"openshift-state-metrics-79f6958cdf-vh8rv\" (UID: \"f011eba4-1f12-402c-9516-242892c1f187\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.418163 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6qc\" (UniqueName: \"kubernetes.io/projected/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-api-access-gn6qc\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.418339 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.418339 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.418339 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.418492 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.418792 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.418986 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.418967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.419064 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.419031    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.419703 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.419680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.420830 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.420807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.420905 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.420857    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.426591 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.426570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6qc\" (UniqueName: \"kubernetes.io/projected/f3a69458-b8bf-4c5c-a343-8bd00877ca2e-kube-api-access-gn6qc\") pod \"kube-state-metrics-56c5594674-2dbgx\" (UID: \"f3a69458-b8bf-4c5c-a343-8bd00877ca2e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.468950 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.468926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"
Jul 21 01:58:49.491120 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.491097    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zptjp"
Jul 21 01:58:49.516299 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.516277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"
Jul 21 01:58:49.529747 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:49.529720    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bb4c15_e30e_4c36_a026_f4af21128e66.slice/crio-240d46713303e1d3bee0c3f1d2d804ba4ef102b0995493fb60d8d407cd19091b WatchSource:0}: Error finding container 240d46713303e1d3bee0c3f1d2d804ba4ef102b0995493fb60d8d407cd19091b: Status 404 returned error can't find the container with id 240d46713303e1d3bee0c3f1d2d804ba4ef102b0995493fb60d8d407cd19091b
Jul 21 01:58:49.642622 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.642586    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv"]
Jul 21 01:58:49.645013 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:49.644983    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf011eba4_1f12_402c_9516_242892c1f187.slice/crio-0a9adb340e5e4725dc50512cabd4cc137e5c96f8413eca94fbc32fb2a89d6862 WatchSource:0}: Error finding container 0a9adb340e5e4725dc50512cabd4cc137e5c96f8413eca94fbc32fb2a89d6862: Status 404 returned error can't find the container with id 0a9adb340e5e4725dc50512cabd4cc137e5c96f8413eca94fbc32fb2a89d6862
Jul 21 01:58:49.671410 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.671384    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2dbgx"]
Jul 21 01:58:49.674327 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:49.674301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a69458_b8bf_4c5c_a343_8bd00877ca2e.slice/crio-2dd68cec57426381fd6aab2adf53ac991e72e6a612175603ed39f7c7147eac7f WatchSource:0}: Error finding container 2dd68cec57426381fd6aab2adf53ac991e72e6a612175603ed39f7c7147eac7f: Status 404 returned error can't find the container with id 2dd68cec57426381fd6aab2adf53ac991e72e6a612175603ed39f7c7147eac7f
Jul 21 01:58:49.955967 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.955894    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv" event={"ID":"f011eba4-1f12-402c-9516-242892c1f187","Type":"ContainerStarted","Data":"e2f74196daf0297b565db4868f77e1a5b539b34adefda2ba275a20844a38700c"}
Jul 21 01:58:49.956158 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.955979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv" event={"ID":"f011eba4-1f12-402c-9516-242892c1f187","Type":"ContainerStarted","Data":"f5f03af2f928bc9228399b9e7586f9c1ffacbcea4ad59b0119019b091c85138e"}
Jul 21 01:58:49.956158 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.956009    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv" event={"ID":"f011eba4-1f12-402c-9516-242892c1f187","Type":"ContainerStarted","Data":"0a9adb340e5e4725dc50512cabd4cc137e5c96f8413eca94fbc32fb2a89d6862"}
Jul 21 01:58:49.957681 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.957598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx" event={"ID":"f3a69458-b8bf-4c5c-a343-8bd00877ca2e","Type":"ContainerStarted","Data":"2dd68cec57426381fd6aab2adf53ac991e72e6a612175603ed39f7c7147eac7f"}
Jul 21 01:58:49.960275 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:49.960226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zptjp" event={"ID":"75bb4c15-e30e-4c36-a026-f4af21128e66","Type":"ContainerStarted","Data":"240d46713303e1d3bee0c3f1d2d804ba4ef102b0995493fb60d8d407cd19091b"}
Jul 21 01:58:50.017560 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:50.017514    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xfkbj" podUID="6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4"
Jul 21 01:58:50.928958 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:50.928917    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4fw89"
Jul 21 01:58:50.966780 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:50.966745    2574 generic.go:356] "Generic (PLEG): container finished" podID="75bb4c15-e30e-4c36-a026-f4af21128e66" containerID="a68b785675d2d51ef3f71d3d7f066eb3ce94399ad56a8c11043b70ac08f5476d" exitCode=0
Jul 21 01:58:50.966935 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:50.966810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zptjp" event={"ID":"75bb4c15-e30e-4c36-a026-f4af21128e66","Type":"ContainerDied","Data":"a68b785675d2d51ef3f71d3d7f066eb3ce94399ad56a8c11043b70ac08f5476d"}
Jul 21 01:58:51.096906 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.096861    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57f9f86975-shkmd"]
Jul 21 01:58:51.099685 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.099657    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.102461 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.102431    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 01:58:51.102608 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.102469    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 01:58:51.102608 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.102485    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 01:58:51.102608 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.102546    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 01:58:51.102795 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.102671    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 01:58:51.102795 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.102784    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s6sv4\""
Jul 21 01:58:51.103150 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.103020    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3r60rbqok4v0p\""
Jul 21 01:58:51.112629 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.112596    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57f9f86975-shkmd"]
Jul 21 01:58:51.135727 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.135910 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135748    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxrsc\" (UniqueName: \"kubernetes.io/projected/912914b4-a201-4a7a-88cf-5be293862ba2-kube-api-access-dxrsc\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.135910 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-tls\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.135910 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/912914b4-a201-4a7a-88cf-5be293862ba2-metrics-client-ca\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.135910 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.136111 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.136111 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.135967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-grpc-tls\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.136111 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.136062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxrsc\" (UniqueName: \"kubernetes.io/projected/912914b4-a201-4a7a-88cf-5be293862ba2-kube-api-access-dxrsc\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237321    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-tls\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/912914b4-a201-4a7a-88cf-5be293862ba2-metrics-client-ca\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237715 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237715 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-grpc-tls\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237715 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.237715 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.237609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.238455 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.238426    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/912914b4-a201-4a7a-88cf-5be293862ba2-metrics-client-ca\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.240706 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.240680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.241267 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.241160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-tls\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.241795 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.241752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.241998 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.241963    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-grpc-tls\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.242104 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.242075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.242414 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.242366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/912914b4-a201-4a7a-88cf-5be293862ba2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.245547 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.245528    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxrsc\" (UniqueName: \"kubernetes.io/projected/912914b4-a201-4a7a-88cf-5be293862ba2-kube-api-access-dxrsc\") pod \"thanos-querier-57f9f86975-shkmd\" (UID: \"912914b4-a201-4a7a-88cf-5be293862ba2\") " pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.412403 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.412366    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:51.570365 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.569296    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57f9f86975-shkmd"]
Jul 21 01:58:51.571959 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:58:51.571922    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912914b4_a201_4a7a_88cf_5be293862ba2.slice/crio-2db82d25ef55200239faba231d6140c255ab15cb871c43f8e6280b0cbef69214 WatchSource:0}: Error finding container 2db82d25ef55200239faba231d6140c255ab15cb871c43f8e6280b0cbef69214: Status 404 returned error can't find the container with id 2db82d25ef55200239faba231d6140c255ab15cb871c43f8e6280b0cbef69214
Jul 21 01:58:51.972218 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.972178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"2db82d25ef55200239faba231d6140c255ab15cb871c43f8e6280b0cbef69214"}
Jul 21 01:58:51.974550 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.974510    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv" event={"ID":"f011eba4-1f12-402c-9516-242892c1f187","Type":"ContainerStarted","Data":"59d4a2657f02dc3053b917910ad3d58fd0827afa3ea34eb93122198d59096dc7"}
Jul 21 01:58:51.976712 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.976683    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx" event={"ID":"f3a69458-b8bf-4c5c-a343-8bd00877ca2e","Type":"ContainerStarted","Data":"373a433ed334f1b2710d7a1af3c0ed21739b9c721ad6293df4628ad7d182c62e"}
Jul 21 01:58:51.976850 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.976747    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx" event={"ID":"f3a69458-b8bf-4c5c-a343-8bd00877ca2e","Type":"ContainerStarted","Data":"8fef9c35f46d9b6ec9792fb0947080f71aa50b38c9d7815d91dfee73c544ba18"}
Jul 21 01:58:51.976850 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.976775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx" event={"ID":"f3a69458-b8bf-4c5c-a343-8bd00877ca2e","Type":"ContainerStarted","Data":"750925df9aa442670ea46d86c214060754a7ff60e7c3973a6cc435f7e4bcb140"}
Jul 21 01:58:51.978921 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.978894    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zptjp" event={"ID":"75bb4c15-e30e-4c36-a026-f4af21128e66","Type":"ContainerStarted","Data":"bdb2575d2d72fd7aa7ce66f344d3edc7c2bcbf1fea8594abf875b3d51a3dc811"}
Jul 21 01:58:51.979040 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.978950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zptjp" event={"ID":"75bb4c15-e30e-4c36-a026-f4af21128e66","Type":"ContainerStarted","Data":"d37749d4378567288109dbddf111821a38834ae7aeed0e33197c8e6a66bd7651"}
Jul 21 01:58:51.993953 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:51.993893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vh8rv" podStartSLOduration=2.658408449 podStartE2EDuration="3.993874696s" totalImagesPullingTime="1.335466247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:51.992743839 +0000 UTC m=+299.734550185" watchObservedRunningTime="2026-07-21 01:58:51.993874696 +0000 UTC m=+299.735681036"
Jul 21 01:58:52.013840 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.013786    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2dbgx" podStartSLOduration=2.472791715 podStartE2EDuration="4.013769986s" totalImagesPullingTime="1.540978271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:52.012893236 +0000 UTC m=+299.754699578" watchObservedRunningTime="2026-07-21 01:58:52.013769986 +0000 UTC m=+299.755576372"
Jul 21 01:58:52.031728 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.031671    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zptjp" podStartSLOduration=3.175270274 podStartE2EDuration="4.03164946s" totalImagesPullingTime="787.557583ms" totalInitContainerRuntime="68.821603ms" isStatefulPod=true podCreationTimestamp="2026-07-21 01:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:52.029718672 +0000 UTC m=+299.771525024" watchObservedRunningTime="2026-07-21 01:58:52.03164946 +0000 UTC m=+299.773455802"
Jul 21 01:58:52.764002 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.763976    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 01:58:52.771359 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.771324    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 01:58:52.776319 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.776299    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 01:58:52.795978 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.795954    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 01:58:52.802023 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:52.801997    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 01:58:53.628906 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:53.628880    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:53.990487 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:53.990447    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"f1b8dd5aba8166b92a03bb24e83c836394573b33dc1e63108883c4973fe27ef0"}
Jul 21 01:58:53.990674 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:53.990544    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"4c52ba8d264f30870e1a9e6b6101834cca0e16a71011db569fd5487040801416"}
Jul 21 01:58:53.990674 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:53.990584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"9d52c47583488c092454075b6ae8de4a5a7376064b6c172c683325dc882fcee2"}
Jul 21 01:58:54.996884 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:54.996844    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"2123bb29414fac1c8957cf3da20120871172b6254d31f43b81b48b778b7bbda5"}
Jul 21 01:58:54.997284 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:54.996928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"aeb0d09b2e308f154b353eccb79de214f006ff6f9be9fe3aa0921603b2a71234"}
Jul 21 01:58:54.997284 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:54.996974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" event={"ID":"912914b4-a201-4a7a-88cf-5be293862ba2","Type":"ContainerStarted","Data":"62fc4bf8ce57dda7313d7502976dde6206a4884c640ebd607f3bacc52cea1bb0"}
Jul 21 01:58:54.997284 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:54.997018    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:58:55.020469 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:55.020419    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd" podStartSLOduration=1.458441907 podStartE2EDuration="4.020402112s" totalImagesPullingTime="2.561960205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:55.018919069 +0000 UTC m=+302.760725454" watchObservedRunningTime="2026-07-21 01:58:55.020402112 +0000 UTC m=+302.762208480"
Jul 21 01:58:58.645555 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:58.645506    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" podUID="af316bb2-4344-4694-8466-83fca311b677" containerName="registry" containerID="cri-o://94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79" gracePeriod=30
Jul 21 01:58:58.892605 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:58.892577    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:59.006611 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006577    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-registry-certificates\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.006802 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006649    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-image-registry-private-configuration\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.006802 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006679    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.006802 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006714    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bk48\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-kube-api-access-8bk48\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.006802 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006763    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af316bb2-4344-4694-8466-83fca311b677-ca-trust-extracted\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.007033 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006815    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-trusted-ca\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.007033 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006838    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-bound-sa-token\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.007033 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-installation-pull-secrets\") pod \"af316bb2-4344-4694-8466-83fca311b677\" (UID: \"af316bb2-4344-4694-8466-83fca311b677\") "
Jul 21 01:58:59.007033 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.006994    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:58:59.007335 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.007295    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:58:59.007335 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.007323    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-registry-certificates\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.009485 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.009450    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:58:59.009891 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.009854    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:58:59.010128 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.010078    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:58:59.010394 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.010370    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:58:59.010394 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.010378    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-kube-api-access-8bk48" (OuterVolumeSpecName: "kube-api-access-8bk48") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "kube-api-access-8bk48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:58:59.014720 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.014500    2574 generic.go:356] "Generic (PLEG): container finished" podID="af316bb2-4344-4694-8466-83fca311b677" containerID="94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79" exitCode=0
Jul 21 01:58:59.014720 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.014547    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8"
Jul 21 01:58:59.014720 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.014541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" event={"ID":"af316bb2-4344-4694-8466-83fca311b677","Type":"ContainerDied","Data":"94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79"}
Jul 21 01:58:59.014720 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.014692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5b65dd99-78mf8" event={"ID":"af316bb2-4344-4694-8466-83fca311b677","Type":"ContainerDied","Data":"9e303b47ba16607c03fe8b02fc4ee1522002c19ae23820bdbc03dd26201e0421"}
Jul 21 01:58:59.015124 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.014723    2574 scope.go:117] "RemoveContainer" containerID="94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79"
Jul 21 01:58:59.018695 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.018669    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af316bb2-4344-4694-8466-83fca311b677-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "af316bb2-4344-4694-8466-83fca311b677" (UID: "af316bb2-4344-4694-8466-83fca311b677"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:58:59.027689 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.027665    2574 scope.go:117] "RemoveContainer" containerID="94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79"
Jul 21 01:58:59.027970 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:58:59.027947    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79\": container with ID starting with 94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79 not found: ID does not exist" containerID="94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79"
Jul 21 01:58:59.028049 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.027983    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79"} err="failed to get container status \"94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79\": rpc error: code = NotFound desc = could not find container \"94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79\": container with ID starting with 94bdd645f5e177d57cf90da491cff8dedf80c7990f305d028225235018e3ae79 not found: ID does not exist"
Jul 21 01:58:59.108707 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108675    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-image-registry-private-configuration\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.108707 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108702    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-registry-tls\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.108707 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108714    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bk48\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-kube-api-access-8bk48\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.108936 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108730    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af316bb2-4344-4694-8466-83fca311b677-ca-trust-extracted\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.108936 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108739    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af316bb2-4344-4694-8466-83fca311b677-trusted-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.108936 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108747    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af316bb2-4344-4694-8466-83fca311b677-bound-sa-token\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.108936 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.108755    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af316bb2-4344-4694-8466-83fca311b677-installation-pull-secrets\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:58:59.329984 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.329906    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d5b65dd99-78mf8"]
Jul 21 01:58:59.333740 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:58:59.333717    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d5b65dd99-78mf8"]
Jul 21 01:59:00.015832 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.015799    2574 scope.go:117] "RemoveContainer" containerID="21ca270682fe98d44959c4b3af4d36f1ab8d3095cc35ee0c727202c5d82f09cc"
Jul 21 01:59:00.985791 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.985755    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-pdbsk"]
Jul 21 01:59:00.986087 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.986073    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af316bb2-4344-4694-8466-83fca311b677" containerName="registry"
Jul 21 01:59:00.986135 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.986090    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="af316bb2-4344-4694-8466-83fca311b677" containerName="registry"
Jul 21 01:59:00.986173 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.986163    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="af316bb2-4344-4694-8466-83fca311b677" containerName="registry"
Jul 21 01:59:00.989024 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.989007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:00.993381 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.993361    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 01:59:00.993833 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.993818    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tjv2v\""
Jul 21 01:59:00.994588 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:00.994571    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 01:59:01.000156 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.000136    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-pdbsk"]
Jul 21 01:59:01.007574 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.007556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57f9f86975-shkmd"
Jul 21 01:59:01.020263 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.020222    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af316bb2-4344-4694-8466-83fca311b677" path="/var/lib/kubelet/pods/af316bb2-4344-4694-8466-83fca311b677/volumes"
Jul 21 01:59:01.025278 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.025260    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 01:59:01.025381 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.025336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" event={"ID":"ef8eddcb-07b1-4bc7-8582-5d5df19edf5e","Type":"ContainerStarted","Data":"bbb4b9675e6ac07b62ff6f372ce2f0f01edf8c4be73e8a4d0563a0207baa3bbb"}
Jul 21 01:59:01.025619 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.025598    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:59:01.030692 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.030673    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-55b6r"
Jul 21 01:59:01.056699 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.056647    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-55b6r" podStartSLOduration=53.441396249 podStartE2EDuration="56.056630676s" totalImagesPullingTime="2.615234427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:01.055407291 +0000 UTC m=+308.797213635" watchObservedRunningTime="2026-07-21 01:59:01.056630676 +0000 UTC m=+308.798437017"
Jul 21 01:59:01.126943 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.126901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52dc4\" (UniqueName: \"kubernetes.io/projected/29b3c37d-22e7-4267-9de2-7c2a38c15bba-kube-api-access-52dc4\") pod \"downloads-5bc67dcd46-pdbsk\" (UID: \"29b3c37d-22e7-4267-9de2-7c2a38c15bba\") " pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:01.228218 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.228180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52dc4\" (UniqueName: \"kubernetes.io/projected/29b3c37d-22e7-4267-9de2-7c2a38c15bba-kube-api-access-52dc4\") pod \"downloads-5bc67dcd46-pdbsk\" (UID: \"29b3c37d-22e7-4267-9de2-7c2a38c15bba\") " pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:01.238039 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.237974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52dc4\" (UniqueName: \"kubernetes.io/projected/29b3c37d-22e7-4267-9de2-7c2a38c15bba-kube-api-access-52dc4\") pod \"downloads-5bc67dcd46-pdbsk\" (UID: \"29b3c37d-22e7-4267-9de2-7c2a38c15bba\") " pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:01.298850 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.298820    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:01.425495 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.425468    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-pdbsk"]
Jul 21 01:59:01.427404 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:59:01.427376    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b3c37d_22e7_4267_9de2_7c2a38c15bba.slice/crio-8c925fdb468cebc0e2c1b80c80142648ec87ef019c135cff0b500e23b7c7d1c2 WatchSource:0}: Error finding container 8c925fdb468cebc0e2c1b80c80142648ec87ef019c135cff0b500e23b7c7d1c2: Status 404 returned error can't find the container with id 8c925fdb468cebc0e2c1b80c80142648ec87ef019c135cff0b500e23b7c7d1c2
Jul 21 01:59:01.429541 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:01.429525    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:59:02.034557 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:02.034511    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-pdbsk" event={"ID":"29b3c37d-22e7-4267-9de2-7c2a38c15bba","Type":"ContainerStarted","Data":"8c925fdb468cebc0e2c1b80c80142648ec87ef019c135cff0b500e23b7c7d1c2"}
Jul 21 01:59:03.017731 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:03.017690    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 01:59:10.913942 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.913903    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5857dfb855-zzfc7"]
Jul 21 01:59:10.980975 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.980933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5857dfb855-zzfc7"]
Jul 21 01:59:10.981132 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.981062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:10.984082 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.984055    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 01:59:10.984295 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.984273    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 01:59:10.985174 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.985139    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 01:59:10.985313 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.985146    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 01:59:10.985313 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.985225    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bhrxf\""
Jul 21 01:59:10.985313 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:10.985294    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 01:59:11.118852 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.118817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-serving-cert\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.119032 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.118860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-oauth-serving-cert\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.119032 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.118895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-oauth-config\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.119032 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.118989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bjfc\" (UniqueName: \"kubernetes.io/projected/377b1c2d-7dec-47ae-84c2-6ac08088cec5-kube-api-access-4bjfc\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.119032 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.119016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-config\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.119274 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.119040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-service-ca\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.220196 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.220162    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-serving-cert\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.220196 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.220200    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-oauth-serving-cert\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.220446 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.220247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-oauth-config\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.220446 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.220325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bjfc\" (UniqueName: \"kubernetes.io/projected/377b1c2d-7dec-47ae-84c2-6ac08088cec5-kube-api-access-4bjfc\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.220446 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.220348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-config\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.220446 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.220367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-service-ca\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.221063 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.221013    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-oauth-serving-cert\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.221343 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.221313    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-service-ca\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.221473 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.221345    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-config\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.223166 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.223145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-serving-cert\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.223273 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.223145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-oauth-config\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.229491 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.229466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bjfc\" (UniqueName: \"kubernetes.io/projected/377b1c2d-7dec-47ae-84c2-6ac08088cec5-kube-api-access-4bjfc\") pod \"console-5857dfb855-zzfc7\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") " pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:11.291838 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:11.291797    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:17.434681 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:17.434646    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5857dfb855-zzfc7"]
Jul 21 01:59:17.437975 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:59:17.437942    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377b1c2d_7dec_47ae_84c2_6ac08088cec5.slice/crio-5c83fb16c86c83b4eadc427f7afc01e86283ee6b1e70d120737122dd706a056d WatchSource:0}: Error finding container 5c83fb16c86c83b4eadc427f7afc01e86283ee6b1e70d120737122dd706a056d: Status 404 returned error can't find the container with id 5c83fb16c86c83b4eadc427f7afc01e86283ee6b1e70d120737122dd706a056d
Jul 21 01:59:18.107483 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:18.105630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-pdbsk" event={"ID":"29b3c37d-22e7-4267-9de2-7c2a38c15bba","Type":"ContainerStarted","Data":"24693baadd01f31abbd3c73232157eb1c27db45f0a4c904559801ae980cbe67a"}
Jul 21 01:59:18.107483 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:18.106466    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:18.108473 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:18.108399    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857dfb855-zzfc7" event={"ID":"377b1c2d-7dec-47ae-84c2-6ac08088cec5","Type":"ContainerStarted","Data":"5c83fb16c86c83b4eadc427f7afc01e86283ee6b1e70d120737122dd706a056d"}
Jul 21 01:59:18.115255 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:18.115196    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-pdbsk"
Jul 21 01:59:18.132205 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:18.127887    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-pdbsk" podStartSLOduration=2.161738455 podStartE2EDuration="18.127864282s" totalImagesPullingTime="15.966125827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:18.12531936 +0000 UTC m=+325.867125716" watchObservedRunningTime="2026-07-21 01:59:18.127864282 +0000 UTC m=+325.869670624"
Jul 21 01:59:19.685445 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.685371    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657bbbb87f-wxz7x"]
Jul 21 01:59:19.720316 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.720255    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657bbbb87f-wxz7x"]
Jul 21 01:59:19.720582 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.720421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.730339 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.730292    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 01:59:19.903521 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-serving-cert\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.903699 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903580    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-oauth-config\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.903774 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903709    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-config\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.903774 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-service-ca\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.903903 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-trusted-ca-bundle\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.903903 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6vqr\" (UniqueName: \"kubernetes.io/projected/0ecfd1e4-468a-4783-9b96-29b4e284f255-kube-api-access-c6vqr\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:19.903903 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:19.903826    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-oauth-serving-cert\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005338 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005293    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-config\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-service-ca\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-trusted-ca-bundle\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6vqr\" (UniqueName: \"kubernetes.io/projected/0ecfd1e4-468a-4783-9b96-29b4e284f255-kube-api-access-c6vqr\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-oauth-serving-cert\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-serving-cert\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.005561 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.005505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-oauth-config\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.006620 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.006225    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-config\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.006620 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.006364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-service-ca\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.006620 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.006536    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-oauth-serving-cert\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.007215 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.007169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-trusted-ca-bundle\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.008826 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.008798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-oauth-config\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.009215 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.009174    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-serving-cert\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.016544 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.016209    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6vqr\" (UniqueName: \"kubernetes.io/projected/0ecfd1e4-468a-4783-9b96-29b4e284f255-kube-api-access-c6vqr\") pod \"console-657bbbb87f-wxz7x\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") " pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.033428 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.033392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:20.963994 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:20.963792    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657bbbb87f-wxz7x"]
Jul 21 01:59:20.967029 ip-10-0-141-1 kubenswrapper[2574]: W0721 01:59:20.966992    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecfd1e4_468a_4783_9b96_29b4e284f255.slice/crio-b652be88375e9f6630584d71a69ab211ea65d1ab07bca4e05b70541968311531 WatchSource:0}: Error finding container b652be88375e9f6630584d71a69ab211ea65d1ab07bca4e05b70541968311531: Status 404 returned error can't find the container with id b652be88375e9f6630584d71a69ab211ea65d1ab07bca4e05b70541968311531
Jul 21 01:59:21.126272 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:21.126169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657bbbb87f-wxz7x" event={"ID":"0ecfd1e4-468a-4783-9b96-29b4e284f255","Type":"ContainerStarted","Data":"b652be88375e9f6630584d71a69ab211ea65d1ab07bca4e05b70541968311531"}
Jul 21 01:59:22.132980 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:22.132938    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857dfb855-zzfc7" event={"ID":"377b1c2d-7dec-47ae-84c2-6ac08088cec5","Type":"ContainerStarted","Data":"76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05"}
Jul 21 01:59:22.134739 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:22.134703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657bbbb87f-wxz7x" event={"ID":"0ecfd1e4-468a-4783-9b96-29b4e284f255","Type":"ContainerStarted","Data":"4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6"}
Jul 21 01:59:22.153871 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:22.153816    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5857dfb855-zzfc7" podStartSLOduration=8.388784973 podStartE2EDuration="12.153800568s" totalImagesPullingTime="3.765015595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:22.151671145 +0000 UTC m=+329.893477509" watchObservedRunningTime="2026-07-21 01:59:22.153800568 +0000 UTC m=+329.895606910"
Jul 21 01:59:22.172119 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:22.172063    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657bbbb87f-wxz7x" podStartSLOduration=2.631773643 podStartE2EDuration="3.172046028s" totalImagesPullingTime="540.272385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:22.170812936 +0000 UTC m=+329.912619277" watchObservedRunningTime="2026-07-21 01:59:22.172046028 +0000 UTC m=+329.913852472"
Jul 21 01:59:30.034058 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:30.034019    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:30.034555 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:30.034075    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:30.040250 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:30.040202    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:30.172608 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:30.172579    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 01:59:30.224527 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:30.224493    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5857dfb855-zzfc7"]
Jul 21 01:59:31.292593 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:31.292556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:40.205405 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:40.205371    2574 generic.go:356] "Generic (PLEG): container finished" podID="19affe16-d907-4db5-8431-8f79c72b7ad9" containerID="6351b5b4bbd6a8474cec6f96c65e9475334a3c8d76aa0bdd2cf443bf40638d88" exitCode=0
Jul 21 01:59:40.205830 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:40.205420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jzr2d" event={"ID":"19affe16-d907-4db5-8431-8f79c72b7ad9","Type":"ContainerDied","Data":"6351b5b4bbd6a8474cec6f96c65e9475334a3c8d76aa0bdd2cf443bf40638d88"}
Jul 21 01:59:40.205830 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:40.205753    2574 scope.go:117] "RemoveContainer" containerID="6351b5b4bbd6a8474cec6f96c65e9475334a3c8d76aa0bdd2cf443bf40638d88"
Jul 21 01:59:40.729565 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:40.729532    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69778848fd-sbjnc_f7ef1d90-623b-49cf-92d0-7d85ca88d545/router/0.log"
Jul 21 01:59:40.735671 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:40.735643    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cpswz_9e26a01e-f32f-4d79-9b03-115e2e69d208/serve-healthcheck-canary/0.log"
Jul 21 01:59:41.211229 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:41.211150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jzr2d" event={"ID":"19affe16-d907-4db5-8431-8f79c72b7ad9","Type":"ContainerStarted","Data":"2edba6026fe4058fe7fd2b8483f569376cd4f714900788f57bb55bdcb2ea150c"}
Jul 21 01:59:55.246675 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.246604    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5857dfb855-zzfc7" podUID="377b1c2d-7dec-47ae-84c2-6ac08088cec5" containerName="console" containerID="cri-o://76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05" gracePeriod=15
Jul 21 01:59:55.527954 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.527916    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:55.621669 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.621631    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-oauth-config\") pod \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") "
Jul 21 01:59:55.621840 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.621683    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-service-ca\") pod \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") "
Jul 21 01:59:55.621840 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.621724    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-serving-cert\") pod \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") "
Jul 21 01:59:55.621840 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.621741    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-config\") pod \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") "
Jul 21 01:59:55.621840 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.621802    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bjfc\" (UniqueName: \"kubernetes.io/projected/377b1c2d-7dec-47ae-84c2-6ac08088cec5-kube-api-access-4bjfc\") pod \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") "
Jul 21 01:59:55.622049 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.621928    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-oauth-serving-cert\") pod \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\" (UID: \"377b1c2d-7dec-47ae-84c2-6ac08088cec5\") "
Jul 21 01:59:55.622251 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.622192    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-config" (OuterVolumeSpecName: "console-config") pod "377b1c2d-7dec-47ae-84c2-6ac08088cec5" (UID: "377b1c2d-7dec-47ae-84c2-6ac08088cec5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:59:55.622375 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.622205    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-service-ca" (OuterVolumeSpecName: "service-ca") pod "377b1c2d-7dec-47ae-84c2-6ac08088cec5" (UID: "377b1c2d-7dec-47ae-84c2-6ac08088cec5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:59:55.622511 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.622492    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "377b1c2d-7dec-47ae-84c2-6ac08088cec5" (UID: "377b1c2d-7dec-47ae-84c2-6ac08088cec5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:59:55.624040 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.624016    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "377b1c2d-7dec-47ae-84c2-6ac08088cec5" (UID: "377b1c2d-7dec-47ae-84c2-6ac08088cec5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:59:55.624282 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.624265    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "377b1c2d-7dec-47ae-84c2-6ac08088cec5" (UID: "377b1c2d-7dec-47ae-84c2-6ac08088cec5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:59:55.624343 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.624299    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377b1c2d-7dec-47ae-84c2-6ac08088cec5-kube-api-access-4bjfc" (OuterVolumeSpecName: "kube-api-access-4bjfc") pod "377b1c2d-7dec-47ae-84c2-6ac08088cec5" (UID: "377b1c2d-7dec-47ae-84c2-6ac08088cec5"). InnerVolumeSpecName "kube-api-access-4bjfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:59:55.723293 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.723227    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-oauth-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:59:55.723293 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.723297    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:59:55.723505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.723311    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:59:55.723505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.723327    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-console-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:59:55.723505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.723342    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bjfc\" (UniqueName: \"kubernetes.io/projected/377b1c2d-7dec-47ae-84c2-6ac08088cec5-kube-api-access-4bjfc\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:59:55.723505 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:55.723357    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/377b1c2d-7dec-47ae-84c2-6ac08088cec5-oauth-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 01:59:56.269290 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.269221    2574 generic.go:356] "Generic (PLEG): container finished" podID="377b1c2d-7dec-47ae-84c2-6ac08088cec5" containerID="76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05" exitCode=0
Jul 21 01:59:56.269290 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.269288    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857dfb855-zzfc7"
Jul 21 01:59:56.269842 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.269347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857dfb855-zzfc7" event={"ID":"377b1c2d-7dec-47ae-84c2-6ac08088cec5","Type":"ContainerDied","Data":"76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05"}
Jul 21 01:59:56.269842 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.269402    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857dfb855-zzfc7" event={"ID":"377b1c2d-7dec-47ae-84c2-6ac08088cec5","Type":"ContainerDied","Data":"5c83fb16c86c83b4eadc427f7afc01e86283ee6b1e70d120737122dd706a056d"}
Jul 21 01:59:56.269842 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.269433    2574 scope.go:117] "RemoveContainer" containerID="76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05"
Jul 21 01:59:56.283687 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.283662    2574 scope.go:117] "RemoveContainer" containerID="76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05"
Jul 21 01:59:56.284021 ip-10-0-141-1 kubenswrapper[2574]: E0721 01:59:56.283993    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05\": container with ID starting with 76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05 not found: ID does not exist" containerID="76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05"
Jul 21 01:59:56.284100 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.284033    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05"} err="failed to get container status \"76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05\": rpc error: code = NotFound desc = could not find container \"76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05\": container with ID starting with 76866357ee59f0b39fe40cf4261c6e27702548abc0105a966fef9e890e00dc05 not found: ID does not exist"
Jul 21 01:59:56.293687 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.293656    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5857dfb855-zzfc7"]
Jul 21 01:59:56.294839 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:56.294820    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5857dfb855-zzfc7"]
Jul 21 01:59:57.020817 ip-10-0-141-1 kubenswrapper[2574]: I0721 01:59:57.020780    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377b1c2d-7dec-47ae-84c2-6ac08088cec5" path="/var/lib/kubelet/pods/377b1c2d-7dec-47ae-84c2-6ac08088cec5/volumes"
Jul 21 02:00:05.708514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:05.708469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 02:00:05.710773 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:05.710750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4-metrics-certs\") pod \"network-metrics-daemon-xfkbj\" (UID: \"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4\") " pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 02:00:05.721808 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:05.721787    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gmrt\""
Jul 21 02:00:05.729248 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:05.729209    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfkbj"
Jul 21 02:00:05.866801 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:05.866769    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xfkbj"]
Jul 21 02:00:05.870284 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:00:05.870228    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4fcc0f_2d7c_4e9e_8c12_b4fb55dc01e4.slice/crio-670cc1ae1a78990e1e2279e82b3c244384e395168b97d1f64c2aadfb48d27dc1 WatchSource:0}: Error finding container 670cc1ae1a78990e1e2279e82b3c244384e395168b97d1f64c2aadfb48d27dc1: Status 404 returned error can't find the container with id 670cc1ae1a78990e1e2279e82b3c244384e395168b97d1f64c2aadfb48d27dc1
Jul 21 02:00:06.308300 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:06.308262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfkbj" event={"ID":"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4","Type":"ContainerStarted","Data":"670cc1ae1a78990e1e2279e82b3c244384e395168b97d1f64c2aadfb48d27dc1"}
Jul 21 02:00:08.318602 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:08.318560    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfkbj" event={"ID":"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4","Type":"ContainerStarted","Data":"0a8e79520ca03f7c5b62ee46fcad9397aa0ca71375a850326d0c78fb5af84b1d"}
Jul 21 02:00:08.319089 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:08.318626    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfkbj" event={"ID":"6e4fcc0f-2d7c-4e9e-8c12-b4fb55dc01e4","Type":"ContainerStarted","Data":"954d67d542071bc40c309f7a57beab807f72aedec47265c5ef97345a716856a5"}
Jul 21 02:00:08.337382 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:08.337336    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xfkbj" podStartSLOduration=373.712259055 podStartE2EDuration="6m15.337321582s" totalImagesPullingTime="1.625062527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:00:08.335281618 +0000 UTC m=+376.077087959" watchObservedRunningTime="2026-07-21 02:00:08.337321582 +0000 UTC m=+376.079127923"
Jul 21 02:00:17.950789 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:17.950749    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-577fc75d54-5z9vt"]
Jul 21 02:00:17.951364 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:17.951169    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377b1c2d-7dec-47ae-84c2-6ac08088cec5" containerName="console"
Jul 21 02:00:17.951364 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:17.951184    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="377b1c2d-7dec-47ae-84c2-6ac08088cec5" containerName="console"
Jul 21 02:00:17.951364 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:17.951263    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="377b1c2d-7dec-47ae-84c2-6ac08088cec5" containerName="console"
Jul 21 02:00:17.953280 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:17.953258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:17.965269 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:17.965217    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577fc75d54-5z9vt"]
Jul 21 02:00:18.009980 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.009940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-oauth-config\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.010139 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.010020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-config\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.010139 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.010041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-trusted-ca-bundle\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.010139 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.010061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-service-ca\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.010281 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.010143    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7tbj\" (UniqueName: \"kubernetes.io/projected/3919b059-9431-42fa-bb22-08ced9dbf9d6-kube-api-access-p7tbj\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.010281 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.010174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-oauth-serving-cert\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.010281 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.010197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-serving-cert\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.110829 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.110794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-config\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.110829 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.110828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-trusted-ca-bundle\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111044 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.110851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-service-ca\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111044 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.110914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7tbj\" (UniqueName: \"kubernetes.io/projected/3919b059-9431-42fa-bb22-08ced9dbf9d6-kube-api-access-p7tbj\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111044 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.110943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-oauth-serving-cert\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111044 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.110975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-serving-cert\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111044 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.111003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-oauth-config\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111672 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.111642    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-config\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111786 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.111684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-service-ca\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111786 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.111748    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-oauth-serving-cert\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.111865 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.111850    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-trusted-ca-bundle\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.113576 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.113559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-oauth-config\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.113654 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.113633    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-serving-cert\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.118582 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.118555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7tbj\" (UniqueName: \"kubernetes.io/projected/3919b059-9431-42fa-bb22-08ced9dbf9d6-kube-api-access-p7tbj\") pod \"console-577fc75d54-5z9vt\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") " pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.263352 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.263320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:18.399205 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:18.399043    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577fc75d54-5z9vt"]
Jul 21 02:00:18.402135 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:00:18.402105    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3919b059_9431_42fa_bb22_08ced9dbf9d6.slice/crio-931cf8ce81c90b1e8874aa214ce89d32abee83abbd3b8bb4b301a96788445a71 WatchSource:0}: Error finding container 931cf8ce81c90b1e8874aa214ce89d32abee83abbd3b8bb4b301a96788445a71: Status 404 returned error can't find the container with id 931cf8ce81c90b1e8874aa214ce89d32abee83abbd3b8bb4b301a96788445a71
Jul 21 02:00:19.362864 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:19.362828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc75d54-5z9vt" event={"ID":"3919b059-9431-42fa-bb22-08ced9dbf9d6","Type":"ContainerStarted","Data":"4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d"}
Jul 21 02:00:19.363276 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:19.362879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc75d54-5z9vt" event={"ID":"3919b059-9431-42fa-bb22-08ced9dbf9d6","Type":"ContainerStarted","Data":"931cf8ce81c90b1e8874aa214ce89d32abee83abbd3b8bb4b301a96788445a71"}
Jul 21 02:00:19.382687 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:19.382636    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-577fc75d54-5z9vt" podStartSLOduration=2.382617104 podStartE2EDuration="2.382617104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:00:19.381251999 +0000 UTC m=+387.123058333" watchObservedRunningTime="2026-07-21 02:00:19.382617104 +0000 UTC m=+387.124423518"
Jul 21 02:00:28.263801 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:28.263763    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:28.264320 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:28.263867    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:28.268284 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:28.268252    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:28.402261 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:28.402218    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:00:28.447856 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:28.447823    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657bbbb87f-wxz7x"]
Jul 21 02:00:53.471533 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.471467    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-657bbbb87f-wxz7x" podUID="0ecfd1e4-468a-4783-9b96-29b4e284f255" containerName="console" containerID="cri-o://4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6" gracePeriod=15
Jul 21 02:00:53.711810 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.711784    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 02:00:53.821049 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.820967    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-serving-cert\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821049 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821033    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-service-ca\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821304 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821054    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-config\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821304 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821098    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-oauth-config\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821304 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821118    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-trusted-ca-bundle\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821304 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821168    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6vqr\" (UniqueName: \"kubernetes.io/projected/0ecfd1e4-468a-4783-9b96-29b4e284f255-kube-api-access-c6vqr\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821304 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821200    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-oauth-serving-cert\") pod \"0ecfd1e4-468a-4783-9b96-29b4e284f255\" (UID: \"0ecfd1e4-468a-4783-9b96-29b4e284f255\") "
Jul 21 02:00:53.821574 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821424    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:00:53.821574 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821492    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-config" (OuterVolumeSpecName: "console-config") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:00:53.821754 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821710    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:00:53.821832 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.821813    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:00:53.823469 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.823438    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ecfd1e4-468a-4783-9b96-29b4e284f255-kube-api-access-c6vqr" (OuterVolumeSpecName: "kube-api-access-c6vqr") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "kube-api-access-c6vqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:00:53.823613 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.823593    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:00:53.823689 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.823615    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ecfd1e4-468a-4783-9b96-29b4e284f255" (UID: "0ecfd1e4-468a-4783-9b96-29b4e284f255"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:00:53.921923 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921888    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:53.921923 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921916    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:53.921923 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921926    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-oauth-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:53.922135 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921935    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-trusted-ca-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:53.922135 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921945    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6vqr\" (UniqueName: \"kubernetes.io/projected/0ecfd1e4-468a-4783-9b96-29b4e284f255-kube-api-access-c6vqr\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:53.922135 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921954    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecfd1e4-468a-4783-9b96-29b4e284f255-oauth-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:53.922135 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:53.921962    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecfd1e4-468a-4783-9b96-29b4e284f255-console-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:00:54.498471 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.498437    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ecfd1e4-468a-4783-9b96-29b4e284f255" containerID="4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6" exitCode=0
Jul 21 02:00:54.498940 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.498487    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657bbbb87f-wxz7x"
Jul 21 02:00:54.498940 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.498530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657bbbb87f-wxz7x" event={"ID":"0ecfd1e4-468a-4783-9b96-29b4e284f255","Type":"ContainerDied","Data":"4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6"}
Jul 21 02:00:54.498940 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.498594    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657bbbb87f-wxz7x" event={"ID":"0ecfd1e4-468a-4783-9b96-29b4e284f255","Type":"ContainerDied","Data":"b652be88375e9f6630584d71a69ab211ea65d1ab07bca4e05b70541968311531"}
Jul 21 02:00:54.498940 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.498627    2574 scope.go:117] "RemoveContainer" containerID="4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6"
Jul 21 02:00:54.507734 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.507716    2574 scope.go:117] "RemoveContainer" containerID="4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6"
Jul 21 02:00:54.508013 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:00:54.507995    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6\": container with ID starting with 4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6 not found: ID does not exist" containerID="4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6"
Jul 21 02:00:54.508057 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.508023    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6"} err="failed to get container status \"4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6\": rpc error: code = NotFound desc = could not find container \"4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6\": container with ID starting with 4c3aee590a12dd652d46b295af78db783294fe8c07816b47366f2af9892ab9f6 not found: ID does not exist"
Jul 21 02:00:54.519743 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.519715    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657bbbb87f-wxz7x"]
Jul 21 02:00:54.523897 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:54.523872    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657bbbb87f-wxz7x"]
Jul 21 02:00:55.020886 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:00:55.020849    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ecfd1e4-468a-4783-9b96-29b4e284f255" path="/var/lib/kubelet/pods/0ecfd1e4-468a-4783-9b96-29b4e284f255/volumes"
Jul 21 02:01:31.794012 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.793975    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7765cc9f69-s2qwz"]
Jul 21 02:01:31.794513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.794275    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ecfd1e4-468a-4783-9b96-29b4e284f255" containerName="console"
Jul 21 02:01:31.794513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.794287    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ecfd1e4-468a-4783-9b96-29b4e284f255" containerName="console"
Jul 21 02:01:31.794513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.794361    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ecfd1e4-468a-4783-9b96-29b4e284f255" containerName="console"
Jul 21 02:01:31.796368 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.796349    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.800387 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:01:31.800350    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-7765cc9f69-s2qwz\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.843991 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.843950    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7765cc9f69-s2qwz"]
Jul 21 02:01:31.922375 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-service-ca\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.922375 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-oauth-serving-cert\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.922588 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922400    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-trusted-ca-bundle\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.922588 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922465    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvrn\" (UniqueName: \"kubernetes.io/projected/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-kube-api-access-jlvrn\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.922588 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-config\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.922588 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922546    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-serving-cert\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:31.922588 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:31.922577    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-oauth-config\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023027 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.022984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-service-ca\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023027 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-oauth-serving-cert\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023302 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-trusted-ca-bundle\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023302 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvrn\" (UniqueName: \"kubernetes.io/projected/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-kube-api-access-jlvrn\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023302 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-config\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023302 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023174    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-serving-cert\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023302 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-oauth-config\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023865 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023839    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-oauth-serving-cert\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023986 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023877    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-config\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.023986 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.023855    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-service-ca\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.024076 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.024042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-trusted-ca-bundle\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.025672 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.025654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-serving-cert\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.025727 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.025690    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-oauth-config\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.032663 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.032633    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvrn\" (UniqueName: \"kubernetes.io/projected/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-kube-api-access-jlvrn\") pod \"console-7765cc9f69-s2qwz\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") " pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.105759 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.105678    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:32.238452 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.238422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7765cc9f69-s2qwz"]
Jul 21 02:01:32.241017 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:01:32.240983    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7bcd14_d4a2_454c_87cd_6688f4f4303b.slice/crio-d19ccf18cff578089f999b00c4dd50b5863a5c831c6b6ae7222a5658cfa5604d WatchSource:0}: Error finding container d19ccf18cff578089f999b00c4dd50b5863a5c831c6b6ae7222a5658cfa5604d: Status 404 returned error can't find the container with id d19ccf18cff578089f999b00c4dd50b5863a5c831c6b6ae7222a5658cfa5604d
Jul 21 02:01:32.646103 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.646063    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7765cc9f69-s2qwz" event={"ID":"8e7bcd14-d4a2-454c-87cd-6688f4f4303b","Type":"ContainerStarted","Data":"62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91"}
Jul 21 02:01:32.646306 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.646116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7765cc9f69-s2qwz" event={"ID":"8e7bcd14-d4a2-454c-87cd-6688f4f4303b","Type":"ContainerStarted","Data":"d19ccf18cff578089f999b00c4dd50b5863a5c831c6b6ae7222a5658cfa5604d"}
Jul 21 02:01:32.664864 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:32.664816    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7765cc9f69-s2qwz" podStartSLOduration=1.664802442 podStartE2EDuration="1.664802442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:01:32.663297246 +0000 UTC m=+460.405103589" watchObservedRunningTime="2026-07-21 02:01:32.664802442 +0000 UTC m=+460.406608782"
Jul 21 02:01:42.106083 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:42.106031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:42.106622 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:42.106108    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:42.111713 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:42.111687    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:42.687480 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:42.687450    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:01:42.752477 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:01:42.752442    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577fc75d54-5z9vt"]
Jul 21 02:02:07.781613 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:07.781575    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-577fc75d54-5z9vt" podUID="3919b059-9431-42fa-bb22-08ced9dbf9d6" containerName="console" containerID="cri-o://4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d" gracePeriod=15
Jul 21 02:02:08.026504 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.026479    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:02:08.114707 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114616    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7tbj\" (UniqueName: \"kubernetes.io/projected/3919b059-9431-42fa-bb22-08ced9dbf9d6-kube-api-access-p7tbj\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.114707 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114662    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-trusted-ca-bundle\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.114707 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114685    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-oauth-config\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.114707 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114708    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-oauth-serving-cert\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.115043 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114733    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-service-ca\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.115043 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114863    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-serving-cert\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.115043 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.114936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-config\") pod \"3919b059-9431-42fa-bb22-08ced9dbf9d6\" (UID: \"3919b059-9431-42fa-bb22-08ced9dbf9d6\") "
Jul 21 02:02:08.115185 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.115078    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:08.115274 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.115193    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-trusted-ca-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.115333 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.115280    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:08.115445 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.115416    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-config" (OuterVolumeSpecName: "console-config") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:08.115504 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.115455    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:08.117025 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.116998    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:02:08.117151 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.117035    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3919b059-9431-42fa-bb22-08ced9dbf9d6-kube-api-access-p7tbj" (OuterVolumeSpecName: "kube-api-access-p7tbj") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "kube-api-access-p7tbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:02:08.117151 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.117044    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3919b059-9431-42fa-bb22-08ced9dbf9d6" (UID: "3919b059-9431-42fa-bb22-08ced9dbf9d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:02:08.215941 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.215908    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.215941 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.215937    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.215941 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.215947    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7tbj\" (UniqueName: \"kubernetes.io/projected/3919b059-9431-42fa-bb22-08ced9dbf9d6-kube-api-access-p7tbj\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.216172 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.215956    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3919b059-9431-42fa-bb22-08ced9dbf9d6-console-oauth-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.216172 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.215964    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-oauth-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.216172 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.215972    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3919b059-9431-42fa-bb22-08ced9dbf9d6-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:02:08.783859 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.783825    2574 generic.go:356] "Generic (PLEG): container finished" podID="3919b059-9431-42fa-bb22-08ced9dbf9d6" containerID="4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d" exitCode=0
Jul 21 02:02:08.784264 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.783868    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577fc75d54-5z9vt"
Jul 21 02:02:08.784264 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.783910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc75d54-5z9vt" event={"ID":"3919b059-9431-42fa-bb22-08ced9dbf9d6","Type":"ContainerDied","Data":"4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d"}
Jul 21 02:02:08.784264 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.783980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577fc75d54-5z9vt" event={"ID":"3919b059-9431-42fa-bb22-08ced9dbf9d6","Type":"ContainerDied","Data":"931cf8ce81c90b1e8874aa214ce89d32abee83abbd3b8bb4b301a96788445a71"}
Jul 21 02:02:08.784264 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.784003    2574 scope.go:117] "RemoveContainer" containerID="4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d"
Jul 21 02:02:08.792849 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.792830    2574 scope.go:117] "RemoveContainer" containerID="4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d"
Jul 21 02:02:08.793137 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:02:08.793101    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d\": container with ID starting with 4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d not found: ID does not exist" containerID="4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d"
Jul 21 02:02:08.793209 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.793142    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d"} err="failed to get container status \"4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d\": rpc error: code = NotFound desc = could not find container \"4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d\": container with ID starting with 4396bb4307e0556441031b77786fb6db3b3a6d2507dc6adfe178d658ab14504d not found: ID does not exist"
Jul 21 02:02:08.810549 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.810522    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577fc75d54-5z9vt"]
Jul 21 02:02:08.819324 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:08.819299    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-577fc75d54-5z9vt"]
Jul 21 02:02:09.020901 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:09.020860    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3919b059-9431-42fa-bb22-08ced9dbf9d6" path="/var/lib/kubelet/pods/3919b059-9431-42fa-bb22-08ced9dbf9d6/volumes"
Jul 21 02:02:46.735247 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.735148    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"]
Jul 21 02:02:46.735717 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.735454    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3919b059-9431-42fa-bb22-08ced9dbf9d6" containerName="console"
Jul 21 02:02:46.735717 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.735467    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3919b059-9431-42fa-bb22-08ced9dbf9d6" containerName="console"
Jul 21 02:02:46.735717 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.735520    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3919b059-9431-42fa-bb22-08ced9dbf9d6" containerName="console"
Jul 21 02:02:46.738352 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.738335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.741624 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.741600    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 02:02:46.741762 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.741625    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cssx4\""
Jul 21 02:02:46.742725 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.742707    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 02:02:46.763566 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.763538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"]
Jul 21 02:02:46.830006 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.829971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5j2\" (UniqueName: \"kubernetes.io/projected/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-kube-api-access-xq5j2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.830006 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.830012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.830259 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.830079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.930733 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.930697    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5j2\" (UniqueName: \"kubernetes.io/projected/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-kube-api-access-xq5j2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.930917 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.930744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.930917 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.930800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.931202 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.931180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.931202 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.931195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:46.940453 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:46.940435    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5j2\" (UniqueName: \"kubernetes.io/projected/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-kube-api-access-xq5j2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:47.046983 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:47.046891    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:02:47.187702 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:47.187639    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"]
Jul 21 02:02:47.190269 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:02:47.190200    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfc4d1a_346b_4539_bd26_f5126c8f14a1.slice/crio-baf489b0f07671bfbe7b8b650aecf6f7db9229c053d7709bb8415be731f8ba31 WatchSource:0}: Error finding container baf489b0f07671bfbe7b8b650aecf6f7db9229c053d7709bb8415be731f8ba31: Status 404 returned error can't find the container with id baf489b0f07671bfbe7b8b650aecf6f7db9229c053d7709bb8415be731f8ba31
Jul 21 02:02:47.934666 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:47.934622    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl" event={"ID":"ddfc4d1a-346b-4539-bd26-f5126c8f14a1","Type":"ContainerStarted","Data":"baf489b0f07671bfbe7b8b650aecf6f7db9229c053d7709bb8415be731f8ba31"}
Jul 21 02:02:54.965670 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:54.965632    2574 generic.go:356] "Generic (PLEG): container finished" podID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerID="273afcde474b015c9f80191da82a9c3e1d3e188ede57c41add8c243eb06ac385" exitCode=0
Jul 21 02:02:54.966062 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:54.965722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl" event={"ID":"ddfc4d1a-346b-4539-bd26-f5126c8f14a1","Type":"ContainerDied","Data":"273afcde474b015c9f80191da82a9c3e1d3e188ede57c41add8c243eb06ac385"}
Jul 21 02:02:56.975520 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:56.975478    2574 generic.go:356] "Generic (PLEG): container finished" podID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerID="7b6714571f27d469d264d8fd77de4ba6d0d8e4a9e6178a0b1dd42eecfcb8e9cb" exitCode=0
Jul 21 02:02:56.975891 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:02:56.975526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl" event={"ID":"ddfc4d1a-346b-4539-bd26-f5126c8f14a1","Type":"ContainerDied","Data":"7b6714571f27d469d264d8fd77de4ba6d0d8e4a9e6178a0b1dd42eecfcb8e9cb"}
Jul 21 02:03:06.013966 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:06.013928    2574 generic.go:356] "Generic (PLEG): container finished" podID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerID="9d114a0bf15afaec11b0398f74c86008a5076eea3d5ceb4f37df005904c43ec1" exitCode=0
Jul 21 02:03:06.014380 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:06.013978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl" event={"ID":"ddfc4d1a-346b-4539-bd26-f5126c8f14a1","Type":"ContainerDied","Data":"9d114a0bf15afaec11b0398f74c86008a5076eea3d5ceb4f37df005904c43ec1"}
Jul 21 02:03:07.139134 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.139108    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:03:07.192614 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.192568    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-util\") pod \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") "
Jul 21 02:03:07.192614 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.192613    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq5j2\" (UniqueName: \"kubernetes.io/projected/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-kube-api-access-xq5j2\") pod \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") "
Jul 21 02:03:07.192854 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.192645    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-bundle\") pod \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\" (UID: \"ddfc4d1a-346b-4539-bd26-f5126c8f14a1\") "
Jul 21 02:03:07.193308 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.193285    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-bundle" (OuterVolumeSpecName: "bundle") pod "ddfc4d1a-346b-4539-bd26-f5126c8f14a1" (UID: "ddfc4d1a-346b-4539-bd26-f5126c8f14a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:07.194826 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.194798    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-kube-api-access-xq5j2" (OuterVolumeSpecName: "kube-api-access-xq5j2") pod "ddfc4d1a-346b-4539-bd26-f5126c8f14a1" (UID: "ddfc4d1a-346b-4539-bd26-f5126c8f14a1"). InnerVolumeSpecName "kube-api-access-xq5j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:07.196987 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.196961    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-util" (OuterVolumeSpecName: "util") pod "ddfc4d1a-346b-4539-bd26-f5126c8f14a1" (UID: "ddfc4d1a-346b-4539-bd26-f5126c8f14a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:07.293188 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.293108    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:07.293188 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.293138    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq5j2\" (UniqueName: \"kubernetes.io/projected/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-kube-api-access-xq5j2\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:07.293188 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:07.293148    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddfc4d1a-346b-4539-bd26-f5126c8f14a1-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:08.022357 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:08.022328    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl"
Jul 21 02:03:08.022525 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:08.022325    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fbgzl" event={"ID":"ddfc4d1a-346b-4539-bd26-f5126c8f14a1","Type":"ContainerDied","Data":"baf489b0f07671bfbe7b8b650aecf6f7db9229c053d7709bb8415be731f8ba31"}
Jul 21 02:03:08.022525 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:08.022448    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baf489b0f07671bfbe7b8b650aecf6f7db9229c053d7709bb8415be731f8ba31"
Jul 21 02:03:15.580147 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580109    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"]
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580415    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="extract"
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580426    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="extract"
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580437    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="pull"
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580443    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="pull"
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580458    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="util"
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580464    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="util"
Jul 21 02:03:15.580589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.580509    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddfc4d1a-346b-4539-bd26-f5126c8f14a1" containerName="extract"
Jul 21 02:03:15.582173 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.582155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.584959 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.584920    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wxbxl\""
Jul 21 02:03:15.585082 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.585027    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 02:03:15.585162 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.585143    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 02:03:15.603484 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.603457    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"]
Jul 21 02:03:15.656192 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.656155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vb8\" (UniqueName: \"kubernetes.io/projected/fe07367a-2051-451d-9b0e-247a7ba781f0-kube-api-access-45vb8\") pod \"cert-manager-operator-controller-manager-55c444bf86-bsr2m\" (UID: \"fe07367a-2051-451d-9b0e-247a7ba781f0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.656379 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.656213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe07367a-2051-451d-9b0e-247a7ba781f0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bsr2m\" (UID: \"fe07367a-2051-451d-9b0e-247a7ba781f0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.757323 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.757283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45vb8\" (UniqueName: \"kubernetes.io/projected/fe07367a-2051-451d-9b0e-247a7ba781f0-kube-api-access-45vb8\") pod \"cert-manager-operator-controller-manager-55c444bf86-bsr2m\" (UID: \"fe07367a-2051-451d-9b0e-247a7ba781f0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.757489 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.757372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe07367a-2051-451d-9b0e-247a7ba781f0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bsr2m\" (UID: \"fe07367a-2051-451d-9b0e-247a7ba781f0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.757906 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.757880    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe07367a-2051-451d-9b0e-247a7ba781f0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bsr2m\" (UID: \"fe07367a-2051-451d-9b0e-247a7ba781f0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.767531 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.767503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vb8\" (UniqueName: \"kubernetes.io/projected/fe07367a-2051-451d-9b0e-247a7ba781f0-kube-api-access-45vb8\") pod \"cert-manager-operator-controller-manager-55c444bf86-bsr2m\" (UID: \"fe07367a-2051-451d-9b0e-247a7ba781f0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:15.892790 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:15.892705    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"
Jul 21 02:03:16.027613 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:16.027586    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m"]
Jul 21 02:03:16.031155 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:16.031122    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe07367a_2051_451d_9b0e_247a7ba781f0.slice/crio-691ef0f5131cf7ca47ee50018b10d48b17f248b0a6774ef3ce431423b258b01d WatchSource:0}: Error finding container 691ef0f5131cf7ca47ee50018b10d48b17f248b0a6774ef3ce431423b258b01d: Status 404 returned error can't find the container with id 691ef0f5131cf7ca47ee50018b10d48b17f248b0a6774ef3ce431423b258b01d
Jul 21 02:03:16.050980 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:16.050950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m" event={"ID":"fe07367a-2051-451d-9b0e-247a7ba781f0","Type":"ContainerStarted","Data":"691ef0f5131cf7ca47ee50018b10d48b17f248b0a6774ef3ce431423b258b01d"}
Jul 21 02:03:18.062931 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:18.062892    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m" event={"ID":"fe07367a-2051-451d-9b0e-247a7ba781f0","Type":"ContainerStarted","Data":"f463ba4fa9fb7b0b56e51bb9a6548e117680bd10a302569ea066c55554ae6bfa"}
Jul 21 02:03:18.095832 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:18.095736    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bsr2m" podStartSLOduration=1.293030761 podStartE2EDuration="3.095719393s" totalImagesPullingTime="1.802688632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:18.093536412 +0000 UTC m=+565.835342753" watchObservedRunningTime="2026-07-21 02:03:18.095719393 +0000 UTC m=+565.837525734"
Jul 21 02:03:19.059346 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.059309    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rp6j9"]
Jul 21 02:03:19.061656 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.061637    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.069488 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.069469    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 02:03:19.069754 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.069511    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 02:03:19.084499 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.084471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86a8d77c-d175-4646-b362-1b95a5071ba2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rp6j9\" (UID: \"86a8d77c-d175-4646-b362-1b95a5071ba2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.084629 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.084536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbnnl\" (UniqueName: \"kubernetes.io/projected/86a8d77c-d175-4646-b362-1b95a5071ba2-kube-api-access-fbnnl\") pod \"cert-manager-webhook-6486ffd997-rp6j9\" (UID: \"86a8d77c-d175-4646-b362-1b95a5071ba2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.185107 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.185072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbnnl\" (UniqueName: \"kubernetes.io/projected/86a8d77c-d175-4646-b362-1b95a5071ba2-kube-api-access-fbnnl\") pod \"cert-manager-webhook-6486ffd997-rp6j9\" (UID: \"86a8d77c-d175-4646-b362-1b95a5071ba2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.185335 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.185159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86a8d77c-d175-4646-b362-1b95a5071ba2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rp6j9\" (UID: \"86a8d77c-d175-4646-b362-1b95a5071ba2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.224112 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.224085    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86a8d77c-d175-4646-b362-1b95a5071ba2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rp6j9\" (UID: \"86a8d77c-d175-4646-b362-1b95a5071ba2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.252024 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.251987    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rp6j9"]
Jul 21 02:03:19.257305 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.257275    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbnnl\" (UniqueName: \"kubernetes.io/projected/86a8d77c-d175-4646-b362-1b95a5071ba2-kube-api-access-fbnnl\") pod \"cert-manager-webhook-6486ffd997-rp6j9\" (UID: \"86a8d77c-d175-4646-b362-1b95a5071ba2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.382228 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.382141    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:19.550129 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.550106    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rp6j9"]
Jul 21 02:03:19.555272 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:19.555228    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86a8d77c_d175_4646_b362_1b95a5071ba2.slice/crio-6fc3a0a7d3cf4756af0da70d199571f8520a9d09735bc477afc606fd769f54fa WatchSource:0}: Error finding container 6fc3a0a7d3cf4756af0da70d199571f8520a9d09735bc477afc606fd769f54fa: Status 404 returned error can't find the container with id 6fc3a0a7d3cf4756af0da70d199571f8520a9d09735bc477afc606fd769f54fa
Jul 21 02:03:19.995320 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.995286    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"]
Jul 21 02:03:19.998408 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:19.998384    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.003665 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.003644    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 02:03:20.004317 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.004291    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 02:03:20.006581 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.006561    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cssx4\""
Jul 21 02:03:20.073513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.073480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9" event={"ID":"86a8d77c-d175-4646-b362-1b95a5071ba2","Type":"ContainerStarted","Data":"6fc3a0a7d3cf4756af0da70d199571f8520a9d09735bc477afc606fd769f54fa"}
Jul 21 02:03:20.089068 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.089038    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"]
Jul 21 02:03:20.091873 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.091843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mmvh\" (UniqueName: \"kubernetes.io/projected/5f0a9769-30b1-4908-8258-39d99234f41f-kube-api-access-9mmvh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.092042 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.092018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.092120 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.092073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.193041 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.192999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mmvh\" (UniqueName: \"kubernetes.io/projected/5f0a9769-30b1-4908-8258-39d99234f41f-kube-api-access-9mmvh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.193218 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.193063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.193345 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.193229    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.193400 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.193384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.193532 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.193515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.210738 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.210709    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mmvh\" (UniqueName: \"kubernetes.io/projected/5f0a9769-30b1-4908-8258-39d99234f41f-kube-api-access-9mmvh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.308039 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.307948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:20.467665 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:20.467627    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"]
Jul 21 02:03:20.471493 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:20.471464    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0a9769_30b1_4908_8258_39d99234f41f.slice/crio-afcc2b35298af71c8ca86e480c2b53a05cd9c09af38fd57fe9d669ed774d8d12 WatchSource:0}: Error finding container afcc2b35298af71c8ca86e480c2b53a05cd9c09af38fd57fe9d669ed774d8d12: Status 404 returned error can't find the container with id afcc2b35298af71c8ca86e480c2b53a05cd9c09af38fd57fe9d669ed774d8d12
Jul 21 02:03:21.079905 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:21.079873    2574 generic.go:356] "Generic (PLEG): container finished" podID="5f0a9769-30b1-4908-8258-39d99234f41f" containerID="0fd9e7520a28cae02fa37d14205d02b3804d1b336ae2794344b20ba5edd6c975" exitCode=0
Jul 21 02:03:21.080334 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:21.079962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g" event={"ID":"5f0a9769-30b1-4908-8258-39d99234f41f","Type":"ContainerDied","Data":"0fd9e7520a28cae02fa37d14205d02b3804d1b336ae2794344b20ba5edd6c975"}
Jul 21 02:03:21.080334 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:21.080026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g" event={"ID":"5f0a9769-30b1-4908-8258-39d99234f41f","Type":"ContainerStarted","Data":"afcc2b35298af71c8ca86e480c2b53a05cd9c09af38fd57fe9d669ed774d8d12"}
Jul 21 02:03:24.095704 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:24.095667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9" event={"ID":"86a8d77c-d175-4646-b362-1b95a5071ba2","Type":"ContainerStarted","Data":"fa2d6f8cec6e78ae8a2968eb75616b2f6730a499633be143065ffd1ce21ddcc8"}
Jul 21 02:03:24.096183 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:24.095738    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:24.097518 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:24.097492    2574 generic.go:356] "Generic (PLEG): container finished" podID="5f0a9769-30b1-4908-8258-39d99234f41f" containerID="618dd2c02f54963e3f86fc312bab150b1d00a88cb55a4a04f6b9b878a0f5af1a" exitCode=0
Jul 21 02:03:24.097628 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:24.097540    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g" event={"ID":"5f0a9769-30b1-4908-8258-39d99234f41f","Type":"ContainerDied","Data":"618dd2c02f54963e3f86fc312bab150b1d00a88cb55a4a04f6b9b878a0f5af1a"}
Jul 21 02:03:24.145984 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:24.145931    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9" podStartSLOduration=1.424100498 podStartE2EDuration="5.145911417s" totalImagesPullingTime="3.721810919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:24.144494328 +0000 UTC m=+571.886300670" watchObservedRunningTime="2026-07-21 02:03:24.145911417 +0000 UTC m=+571.887717761"
Jul 21 02:03:25.103819 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:25.103781    2574 generic.go:356] "Generic (PLEG): container finished" podID="5f0a9769-30b1-4908-8258-39d99234f41f" containerID="78ec69466df41a0e507a73ae258f0fcd47be35a09150e7f90a82ae5c40d03c7b" exitCode=0
Jul 21 02:03:25.104253 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:25.103865    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g" event={"ID":"5f0a9769-30b1-4908-8258-39d99234f41f","Type":"ContainerDied","Data":"78ec69466df41a0e507a73ae258f0fcd47be35a09150e7f90a82ae5c40d03c7b"}
Jul 21 02:03:25.937364 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:25.937327    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"]
Jul 21 02:03:25.939523 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:25.939507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:25.943324 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:25.943299    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9mqjl\""
Jul 21 02:03:25.971110 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:25.971079    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"]
Jul 21 02:03:26.044918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.044883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f06fda4a-2f04-43dd-8eda-0fcd273db8df-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kwvrp\" (UID: \"f06fda4a-2f04-43dd-8eda-0fcd273db8df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.044918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.044923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czw2k\" (UniqueName: \"kubernetes.io/projected/f06fda4a-2f04-43dd-8eda-0fcd273db8df-kube-api-access-czw2k\") pod \"cert-manager-cainjector-559cdd8c87-kwvrp\" (UID: \"f06fda4a-2f04-43dd-8eda-0fcd273db8df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.145356 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.145322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f06fda4a-2f04-43dd-8eda-0fcd273db8df-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kwvrp\" (UID: \"f06fda4a-2f04-43dd-8eda-0fcd273db8df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.145356 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.145361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw2k\" (UniqueName: \"kubernetes.io/projected/f06fda4a-2f04-43dd-8eda-0fcd273db8df-kube-api-access-czw2k\") pod \"cert-manager-cainjector-559cdd8c87-kwvrp\" (UID: \"f06fda4a-2f04-43dd-8eda-0fcd273db8df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.165300 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.165269    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czw2k\" (UniqueName: \"kubernetes.io/projected/f06fda4a-2f04-43dd-8eda-0fcd273db8df-kube-api-access-czw2k\") pod \"cert-manager-cainjector-559cdd8c87-kwvrp\" (UID: \"f06fda4a-2f04-43dd-8eda-0fcd273db8df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.167894 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.167865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f06fda4a-2f04-43dd-8eda-0fcd273db8df-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kwvrp\" (UID: \"f06fda4a-2f04-43dd-8eda-0fcd273db8df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.243323 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.243010    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:26.248301 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.248271    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"
Jul 21 02:03:26.347690 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.347654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-util\") pod \"5f0a9769-30b1-4908-8258-39d99234f41f\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") "
Jul 21 02:03:26.347855 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.347705    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-bundle\") pod \"5f0a9769-30b1-4908-8258-39d99234f41f\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") "
Jul 21 02:03:26.347855 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.347729    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mmvh\" (UniqueName: \"kubernetes.io/projected/5f0a9769-30b1-4908-8258-39d99234f41f-kube-api-access-9mmvh\") pod \"5f0a9769-30b1-4908-8258-39d99234f41f\" (UID: \"5f0a9769-30b1-4908-8258-39d99234f41f\") "
Jul 21 02:03:26.348185 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.348154    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-bundle" (OuterVolumeSpecName: "bundle") pod "5f0a9769-30b1-4908-8258-39d99234f41f" (UID: "5f0a9769-30b1-4908-8258-39d99234f41f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:26.350524 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.350348    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0a9769-30b1-4908-8258-39d99234f41f-kube-api-access-9mmvh" (OuterVolumeSpecName: "kube-api-access-9mmvh") pod "5f0a9769-30b1-4908-8258-39d99234f41f" (UID: "5f0a9769-30b1-4908-8258-39d99234f41f"). InnerVolumeSpecName "kube-api-access-9mmvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:26.352655 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.352627    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-util" (OuterVolumeSpecName: "util") pod "5f0a9769-30b1-4908-8258-39d99234f41f" (UID: "5f0a9769-30b1-4908-8258-39d99234f41f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:26.428840 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.428811    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp"]
Jul 21 02:03:26.431111 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:26.431079    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf06fda4a_2f04_43dd_8eda_0fcd273db8df.slice/crio-8a6051fbadafe7c4ae08ad85ac8b4043d41e51c4af6f1e5a9d2fe9391712457e WatchSource:0}: Error finding container 8a6051fbadafe7c4ae08ad85ac8b4043d41e51c4af6f1e5a9d2fe9391712457e: Status 404 returned error can't find the container with id 8a6051fbadafe7c4ae08ad85ac8b4043d41e51c4af6f1e5a9d2fe9391712457e
Jul 21 02:03:26.448560 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.448538    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:26.448560 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.448561    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0a9769-30b1-4908-8258-39d99234f41f-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:26.448686 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:26.448572    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mmvh\" (UniqueName: \"kubernetes.io/projected/5f0a9769-30b1-4908-8258-39d99234f41f-kube-api-access-9mmvh\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:27.114857 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:27.114827    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g" event={"ID":"5f0a9769-30b1-4908-8258-39d99234f41f","Type":"ContainerDied","Data":"afcc2b35298af71c8ca86e480c2b53a05cd9c09af38fd57fe9d669ed774d8d12"}
Jul 21 02:03:27.115011 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:27.114881    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afcc2b35298af71c8ca86e480c2b53a05cd9c09af38fd57fe9d669ed774d8d12"
Jul 21 02:03:27.115011 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:27.114839    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2l87g"
Jul 21 02:03:27.116476 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:27.116443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp" event={"ID":"f06fda4a-2f04-43dd-8eda-0fcd273db8df","Type":"ContainerStarted","Data":"ae009be9d03cf1c4a12aa6a95b5a6f1290f86884f0edd34c5d8ce98e36b0fea3"}
Jul 21 02:03:27.116476 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:27.116476    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp" event={"ID":"f06fda4a-2f04-43dd-8eda-0fcd273db8df","Type":"ContainerStarted","Data":"8a6051fbadafe7c4ae08ad85ac8b4043d41e51c4af6f1e5a9d2fe9391712457e"}
Jul 21 02:03:27.140728 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:27.140675    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kwvrp" podStartSLOduration=2.140658114 podStartE2EDuration="2.140658114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:27.139515929 +0000 UTC m=+574.881322271" watchObservedRunningTime="2026-07-21 02:03:27.140658114 +0000 UTC m=+574.882464454"
Jul 21 02:03:30.105998 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:30.105968    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rp6j9"
Jul 21 02:03:33.107114 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107082    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"]
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107383    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="extract"
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107396    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="extract"
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107411    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="util"
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107417    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="util"
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107435    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="pull"
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107441    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="pull"
Jul 21 02:03:33.107511 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.107491    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f0a9769-30b1-4908-8258-39d99234f41f" containerName="extract"
Jul 21 02:03:33.134787 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.134761    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"]
Jul 21 02:03:33.134960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.134853    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.138466 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.138443    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 02:03:33.138590 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.138491    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mh8sw\""
Jul 21 02:03:33.139630 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.139609    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 02:03:33.203667 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.203637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82d7aa3-369a-4dc0-a5da-000d04cbd1b9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r6vdf\" (UID: \"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.203667 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.203671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbgg\" (UniqueName: \"kubernetes.io/projected/e82d7aa3-369a-4dc0-a5da-000d04cbd1b9-kube-api-access-vxbgg\") pod \"openshift-lws-operator-fd8ccff4c-r6vdf\" (UID: \"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.304397 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.304358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82d7aa3-369a-4dc0-a5da-000d04cbd1b9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r6vdf\" (UID: \"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.304397 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.304397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbgg\" (UniqueName: \"kubernetes.io/projected/e82d7aa3-369a-4dc0-a5da-000d04cbd1b9-kube-api-access-vxbgg\") pod \"openshift-lws-operator-fd8ccff4c-r6vdf\" (UID: \"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.304813 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.304787    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82d7aa3-369a-4dc0-a5da-000d04cbd1b9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r6vdf\" (UID: \"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.313316 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.313291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbgg\" (UniqueName: \"kubernetes.io/projected/e82d7aa3-369a-4dc0-a5da-000d04cbd1b9-kube-api-access-vxbgg\") pod \"openshift-lws-operator-fd8ccff4c-r6vdf\" (UID: \"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.444031 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.443929    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"
Jul 21 02:03:33.598671 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:33.598646    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf"]
Jul 21 02:03:33.600926 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:33.600897    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode82d7aa3_369a_4dc0_a5da_000d04cbd1b9.slice/crio-2be4c773dd7d546e908eb1e66eeac99b653d48e5ce67934b60881b2e2d16a2b2 WatchSource:0}: Error finding container 2be4c773dd7d546e908eb1e66eeac99b653d48e5ce67934b60881b2e2d16a2b2: Status 404 returned error can't find the container with id 2be4c773dd7d546e908eb1e66eeac99b653d48e5ce67934b60881b2e2d16a2b2
Jul 21 02:03:34.153857 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:34.153822    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf" event={"ID":"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9","Type":"ContainerStarted","Data":"2be4c773dd7d546e908eb1e66eeac99b653d48e5ce67934b60881b2e2d16a2b2"}
Jul 21 02:03:36.165341 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:36.165307    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf" event={"ID":"e82d7aa3-369a-4dc0-a5da-000d04cbd1b9","Type":"ContainerStarted","Data":"280c54bbffb4bcf11caa1d69087216b7990c3476b5dfd223d257fbdb641f98b7"}
Jul 21 02:03:36.182813 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:36.182733    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r6vdf" podStartSLOduration=0.742107196 podStartE2EDuration="3.182717379s" totalImagesPullingTime="2.440610183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:36.181587675 +0000 UTC m=+583.923394029" watchObservedRunningTime="2026-07-21 02:03:36.182717379 +0000 UTC m=+583.924523719"
Jul 21 02:03:38.838002 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.837929    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"]
Jul 21 02:03:38.840824 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.840800    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:38.843580 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.843563    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cssx4\""
Jul 21 02:03:38.843710 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.843578    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 02:03:38.844593 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.844572    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 02:03:38.850541 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.850520    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"]
Jul 21 02:03:38.949573 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.949541    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:38.949762 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.949648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:38.949762 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:38.949675    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mqm\" (UniqueName: \"kubernetes.io/projected/c205af6d-81f3-4e36-bf3d-60320be0ec40-kube-api-access-98mqm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.050804 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.050772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.050971 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.050845    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.050971 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.050868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mqm\" (UniqueName: \"kubernetes.io/projected/c205af6d-81f3-4e36-bf3d-60320be0ec40-kube-api-access-98mqm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.051176 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.051156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.051223 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.051203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.065489 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.065466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mqm\" (UniqueName: \"kubernetes.io/projected/c205af6d-81f3-4e36-bf3d-60320be0ec40-kube-api-access-98mqm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.150427 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.150343    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:39.255706 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.255669    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2c4h5"]
Jul 21 02:03:39.258389 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.258365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.261158 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.261130    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mdrhw\""
Jul 21 02:03:39.270138 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.270113    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2c4h5"]
Jul 21 02:03:39.282507 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.282450    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"]
Jul 21 02:03:39.285016 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:39.284991    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc205af6d_81f3_4e36_bf3d_60320be0ec40.slice/crio-57cdb0cfab7e2613c42f5326e2b711a7a511c4f8e1f1b86ca7b2b734d6ed5550 WatchSource:0}: Error finding container 57cdb0cfab7e2613c42f5326e2b711a7a511c4f8e1f1b86ca7b2b734d6ed5550: Status 404 returned error can't find the container with id 57cdb0cfab7e2613c42f5326e2b711a7a511c4f8e1f1b86ca7b2b734d6ed5550
Jul 21 02:03:39.353921 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.353894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7n6z\" (UniqueName: \"kubernetes.io/projected/4086f9dd-fc07-4d24-b23b-46536ab6d305-kube-api-access-f7n6z\") pod \"cert-manager-55b4d954d5-2c4h5\" (UID: \"4086f9dd-fc07-4d24-b23b-46536ab6d305\") " pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.353921 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.353929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4086f9dd-fc07-4d24-b23b-46536ab6d305-bound-sa-token\") pod \"cert-manager-55b4d954d5-2c4h5\" (UID: \"4086f9dd-fc07-4d24-b23b-46536ab6d305\") " pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.454452 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.454359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n6z\" (UniqueName: \"kubernetes.io/projected/4086f9dd-fc07-4d24-b23b-46536ab6d305-kube-api-access-f7n6z\") pod \"cert-manager-55b4d954d5-2c4h5\" (UID: \"4086f9dd-fc07-4d24-b23b-46536ab6d305\") " pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.454452 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.454404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4086f9dd-fc07-4d24-b23b-46536ab6d305-bound-sa-token\") pod \"cert-manager-55b4d954d5-2c4h5\" (UID: \"4086f9dd-fc07-4d24-b23b-46536ab6d305\") " pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.462750 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.462723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4086f9dd-fc07-4d24-b23b-46536ab6d305-bound-sa-token\") pod \"cert-manager-55b4d954d5-2c4h5\" (UID: \"4086f9dd-fc07-4d24-b23b-46536ab6d305\") " pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.462908 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.462885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7n6z\" (UniqueName: \"kubernetes.io/projected/4086f9dd-fc07-4d24-b23b-46536ab6d305-kube-api-access-f7n6z\") pod \"cert-manager-55b4d954d5-2c4h5\" (UID: \"4086f9dd-fc07-4d24-b23b-46536ab6d305\") " pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.568610 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.568577    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2c4h5"
Jul 21 02:03:39.695465 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:39.695440    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2c4h5"]
Jul 21 02:03:39.697444 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:39.697418    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4086f9dd_fc07_4d24_b23b_46536ab6d305.slice/crio-afe0cafc70c37acfb2f98852f24d9700b556a8253b95a05a2d98682f963bb0fb WatchSource:0}: Error finding container afe0cafc70c37acfb2f98852f24d9700b556a8253b95a05a2d98682f963bb0fb: Status 404 returned error can't find the container with id afe0cafc70c37acfb2f98852f24d9700b556a8253b95a05a2d98682f963bb0fb
Jul 21 02:03:40.184345 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:40.184305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2c4h5" event={"ID":"4086f9dd-fc07-4d24-b23b-46536ab6d305","Type":"ContainerStarted","Data":"ebee3ff719b2c7c2a258d010e94681fd562ca1a8df2ca0e1ef03fad5104fbd9c"}
Jul 21 02:03:40.184735 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:40.184358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2c4h5" event={"ID":"4086f9dd-fc07-4d24-b23b-46536ab6d305","Type":"ContainerStarted","Data":"afe0cafc70c37acfb2f98852f24d9700b556a8253b95a05a2d98682f963bb0fb"}
Jul 21 02:03:40.185667 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:40.185642    2574 generic.go:356] "Generic (PLEG): container finished" podID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerID="97112940ce621af69bb2867066c3dab1f34025c7d8563172f63a2bea0567f239" exitCode=0
Jul 21 02:03:40.185780 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:40.185729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6" event={"ID":"c205af6d-81f3-4e36-bf3d-60320be0ec40","Type":"ContainerDied","Data":"97112940ce621af69bb2867066c3dab1f34025c7d8563172f63a2bea0567f239"}
Jul 21 02:03:40.185829 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:40.185814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6" event={"ID":"c205af6d-81f3-4e36-bf3d-60320be0ec40","Type":"ContainerStarted","Data":"57cdb0cfab7e2613c42f5326e2b711a7a511c4f8e1f1b86ca7b2b734d6ed5550"}
Jul 21 02:03:40.203845 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:40.203805    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2c4h5" podStartSLOduration=1.203790082 podStartE2EDuration="1.203790082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:40.201554984 +0000 UTC m=+587.943361324" watchObservedRunningTime="2026-07-21 02:03:40.203790082 +0000 UTC m=+587.945596423"
Jul 21 02:03:41.191862 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:41.191771    2574 generic.go:356] "Generic (PLEG): container finished" podID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerID="add6aa0bef0da2df5d0eb9b175c174a88925d520f77e3a0fc6e734d2f1480fe7" exitCode=0
Jul 21 02:03:41.192265 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:41.191855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6" event={"ID":"c205af6d-81f3-4e36-bf3d-60320be0ec40","Type":"ContainerDied","Data":"add6aa0bef0da2df5d0eb9b175c174a88925d520f77e3a0fc6e734d2f1480fe7"}
Jul 21 02:03:42.198355 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:42.198309    2574 generic.go:356] "Generic (PLEG): container finished" podID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerID="2122f530f850492aca8c3de20cf3cf299f1156bd7ba28a710af25115a9ad4543" exitCode=0
Jul 21 02:03:42.198738 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:42.198364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6" event={"ID":"c205af6d-81f3-4e36-bf3d-60320be0ec40","Type":"ContainerDied","Data":"2122f530f850492aca8c3de20cf3cf299f1156bd7ba28a710af25115a9ad4543"}
Jul 21 02:03:43.328927 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.328900    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:43.488139 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.488115    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-util\") pod \"c205af6d-81f3-4e36-bf3d-60320be0ec40\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") "
Jul 21 02:03:43.488299 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.488180    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98mqm\" (UniqueName: \"kubernetes.io/projected/c205af6d-81f3-4e36-bf3d-60320be0ec40-kube-api-access-98mqm\") pod \"c205af6d-81f3-4e36-bf3d-60320be0ec40\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") "
Jul 21 02:03:43.488299 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.488223    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-bundle\") pod \"c205af6d-81f3-4e36-bf3d-60320be0ec40\" (UID: \"c205af6d-81f3-4e36-bf3d-60320be0ec40\") "
Jul 21 02:03:43.488956 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.488927    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-bundle" (OuterVolumeSpecName: "bundle") pod "c205af6d-81f3-4e36-bf3d-60320be0ec40" (UID: "c205af6d-81f3-4e36-bf3d-60320be0ec40"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:43.490204 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.490178    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c205af6d-81f3-4e36-bf3d-60320be0ec40-kube-api-access-98mqm" (OuterVolumeSpecName: "kube-api-access-98mqm") pod "c205af6d-81f3-4e36-bf3d-60320be0ec40" (UID: "c205af6d-81f3-4e36-bf3d-60320be0ec40"). InnerVolumeSpecName "kube-api-access-98mqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:43.494140 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.494101    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-util" (OuterVolumeSpecName: "util") pod "c205af6d-81f3-4e36-bf3d-60320be0ec40" (UID: "c205af6d-81f3-4e36-bf3d-60320be0ec40"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:43.589540 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.589513    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:43.589540 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.589535    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98mqm\" (UniqueName: \"kubernetes.io/projected/c205af6d-81f3-4e36-bf3d-60320be0ec40-kube-api-access-98mqm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:43.589540 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:43.589546    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c205af6d-81f3-4e36-bf3d-60320be0ec40-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:03:44.209704 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:44.209670    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6" event={"ID":"c205af6d-81f3-4e36-bf3d-60320be0ec40","Type":"ContainerDied","Data":"57cdb0cfab7e2613c42f5326e2b711a7a511c4f8e1f1b86ca7b2b734d6ed5550"}
Jul 21 02:03:44.209874 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:44.209742    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57cdb0cfab7e2613c42f5326e2b711a7a511c4f8e1f1b86ca7b2b734d6ed5550"
Jul 21 02:03:44.209874 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:44.209687    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvljj6"
Jul 21 02:03:52.795843 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:52.795817    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:03:52.801919 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:52.801899    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:03:52.823787 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:52.823765    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:03:52.829555 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:52.829533    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:03:54.844441 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844407    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"]
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844707    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="util"
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844717    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="util"
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844737    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="extract"
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844743    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="extract"
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844752    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="pull"
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844758    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="pull"
Jul 21 02:03:54.845807 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.844811    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c205af6d-81f3-4e36-bf3d-60320be0ec40" containerName="extract"
Jul 21 02:03:54.846734 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.846717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:54.849274 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.849251    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 02:03:54.849413 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.849259    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 02:03:54.849603 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.849587    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 02:03:54.849671 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.849652    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rnskh\""
Jul 21 02:03:54.849825 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.849809    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 02:03:54.872172 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.872139    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"]
Jul 21 02:03:54.988867 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.988834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a3c4d29-ab23-4a26-9672-efd214c79e2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:54.988867 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.988872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a3c4d29-ab23-4a26-9672-efd214c79e2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:54.989100 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.988901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn8bn\" (UniqueName: \"kubernetes.io/projected/8a3c4d29-ab23-4a26-9672-efd214c79e2a-kube-api-access-bn8bn\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:54.989100 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.988927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a3c4d29-ab23-4a26-9672-efd214c79e2a-manifests\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:54.989100 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:54.988960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a3c4d29-ab23-4a26-9672-efd214c79e2a-tmp\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.090378 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.090341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a3c4d29-ab23-4a26-9672-efd214c79e2a-manifests\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.090561 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.090397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a3c4d29-ab23-4a26-9672-efd214c79e2a-tmp\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.090561 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.090497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a3c4d29-ab23-4a26-9672-efd214c79e2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.090561 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.090531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a3c4d29-ab23-4a26-9672-efd214c79e2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.090756 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.090570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn8bn\" (UniqueName: \"kubernetes.io/projected/8a3c4d29-ab23-4a26-9672-efd214c79e2a-kube-api-access-bn8bn\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.090863 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.090832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a3c4d29-ab23-4a26-9672-efd214c79e2a-manifests\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.093001 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.092963    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a3c4d29-ab23-4a26-9672-efd214c79e2a-tmp\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.093118 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.093039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a3c4d29-ab23-4a26-9672-efd214c79e2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.093174 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.093129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a3c4d29-ab23-4a26-9672-efd214c79e2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.101442 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.101371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn8bn\" (UniqueName: \"kubernetes.io/projected/8a3c4d29-ab23-4a26-9672-efd214c79e2a-kube-api-access-bn8bn\") pod \"opendatahub-operator-controller-manager-5c97f6b6f9-n22sn\" (UID: \"8a3c4d29-ab23-4a26-9672-efd214c79e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.157133 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.157101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:03:55.295352 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:55.295328    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"]
Jul 21 02:03:55.297722 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:03:55.297692    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3c4d29_ab23_4a26_9672_efd214c79e2a.slice/crio-3942c6d4eb2d214791da9a12904408e1c4ed7511f76a15a121cf01f1bb22f53e WatchSource:0}: Error finding container 3942c6d4eb2d214791da9a12904408e1c4ed7511f76a15a121cf01f1bb22f53e: Status 404 returned error can't find the container with id 3942c6d4eb2d214791da9a12904408e1c4ed7511f76a15a121cf01f1bb22f53e
Jul 21 02:03:56.266343 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:56.266292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn" event={"ID":"8a3c4d29-ab23-4a26-9672-efd214c79e2a","Type":"ContainerStarted","Data":"3942c6d4eb2d214791da9a12904408e1c4ed7511f76a15a121cf01f1bb22f53e"}
Jul 21 02:03:59.285694 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:03:59.285651    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn" event={"ID":"8a3c4d29-ab23-4a26-9672-efd214c79e2a","Type":"ContainerStarted","Data":"a7c3dc15f5d3d1694812a48aa3b4ba895d4b4d10af444fe93bc996dcd91a1b4a"}
Jul 21 02:04:00.291896 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:00.291794    2574 generic.go:356] "Generic (PLEG): container finished" podID="8a3c4d29-ab23-4a26-9672-efd214c79e2a" containerID="a7c3dc15f5d3d1694812a48aa3b4ba895d4b4d10af444fe93bc996dcd91a1b4a" exitCode=0
Jul 21 02:04:00.291896 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:00.291852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn" event={"ID":"8a3c4d29-ab23-4a26-9672-efd214c79e2a","Type":"ContainerDied","Data":"a7c3dc15f5d3d1694812a48aa3b4ba895d4b4d10af444fe93bc996dcd91a1b4a"}
Jul 21 02:04:01.298042 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:01.298003    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn" event={"ID":"8a3c4d29-ab23-4a26-9672-efd214c79e2a","Type":"ContainerStarted","Data":"eebf0ccf5965268923c03ca76340b3e325147dc4f45d211db82cbda848dda776"}
Jul 21 02:04:01.298469 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:01.298078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:04:01.322643 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:01.322589    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn" podStartSLOduration=2.102606574 podStartE2EDuration="7.322570177s" totalImagesPullingTime="4.16135682s" totalInitContainerRuntime="1.058606783s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:01.320634715 +0000 UTC m=+609.062441057" watchObservedRunningTime="2026-07-21 02:04:01.322570177 +0000 UTC m=+609.064376518"
Jul 21 02:04:12.304866 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:12.304827    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c97f6b6f9-n22sn"
Jul 21 02:04:15.294323 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.294198    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"]
Jul 21 02:04:15.299867 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.299846    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.314280 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.314211    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 02:04:15.315639 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.315609    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hznsg\""
Jul 21 02:04:15.315763 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.315614    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 02:04:15.318217 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.318159    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"]
Jul 21 02:04:15.367902 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.367812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee0ba38-d648-4ffe-8f17-cad090e04748-tls-certs\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.367902 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.367884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ee0ba38-d648-4ffe-8f17-cad090e04748-tmp\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.368082 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.367927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shsnz\" (UniqueName: \"kubernetes.io/projected/1ee0ba38-d648-4ffe-8f17-cad090e04748-kube-api-access-shsnz\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.469246 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.469198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee0ba38-d648-4ffe-8f17-cad090e04748-tls-certs\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.469439 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.469273    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ee0ba38-d648-4ffe-8f17-cad090e04748-tmp\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.469439 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.469314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shsnz\" (UniqueName: \"kubernetes.io/projected/1ee0ba38-d648-4ffe-8f17-cad090e04748-kube-api-access-shsnz\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.471628 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.471604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ee0ba38-d648-4ffe-8f17-cad090e04748-tmp\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.471942 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.471921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee0ba38-d648-4ffe-8f17-cad090e04748-tls-certs\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.491652 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.491623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shsnz\" (UniqueName: \"kubernetes.io/projected/1ee0ba38-d648-4ffe-8f17-cad090e04748-kube-api-access-shsnz\") pod \"kube-auth-proxy-5b99b8fb9b-6247r\" (UID: \"1ee0ba38-d648-4ffe-8f17-cad090e04748\") " pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.609377 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.609344    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"
Jul 21 02:04:15.764342 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.764312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r"]
Jul 21 02:04:15.766223 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:04:15.766193    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee0ba38_d648_4ffe_8f17_cad090e04748.slice/crio-8bbad9257f2789f2b0165e74cbf70468111e169fabcfb93e39169f9eefbbb62f WatchSource:0}: Error finding container 8bbad9257f2789f2b0165e74cbf70468111e169fabcfb93e39169f9eefbbb62f: Status 404 returned error can't find the container with id 8bbad9257f2789f2b0165e74cbf70468111e169fabcfb93e39169f9eefbbb62f
Jul 21 02:04:15.768460 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.768440    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:04:15.914788 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.914706    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fzbtc"]
Jul 21 02:04:15.917904 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.917880    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:15.924280 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.923066    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-s469m\""
Jul 21 02:04:15.924280 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.923367    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 02:04:15.933851 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.933824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fzbtc"]
Jul 21 02:04:15.973715 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.973675    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5r2x\" (UniqueName: \"kubernetes.io/projected/4633258f-49d6-4967-8739-04527475dd1f-kube-api-access-b5r2x\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:15.973891 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:15.973755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4633258f-49d6-4967-8739-04527475dd1f-cert\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:16.075021 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.074975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4633258f-49d6-4967-8739-04527475dd1f-cert\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:16.075198 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.075056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5r2x\" (UniqueName: \"kubernetes.io/projected/4633258f-49d6-4967-8739-04527475dd1f-kube-api-access-b5r2x\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:16.075198 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:16.075129    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 21 02:04:16.075370 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:16.075200    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4633258f-49d6-4967-8739-04527475dd1f-cert podName:4633258f-49d6-4967-8739-04527475dd1f nodeName:}" failed. No retries permitted until 2026-07-21 02:04:16.575183029 +0000 UTC m=+624.316989351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4633258f-49d6-4967-8739-04527475dd1f-cert") pod "odh-model-controller-7998c67dc4-fzbtc" (UID: "4633258f-49d6-4967-8739-04527475dd1f") : secret "odh-model-controller-webhook-cert" not found
Jul 21 02:04:16.116056 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.116021    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5r2x\" (UniqueName: \"kubernetes.io/projected/4633258f-49d6-4967-8739-04527475dd1f-kube-api-access-b5r2x\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:16.370899 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.370860    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r" event={"ID":"1ee0ba38-d648-4ffe-8f17-cad090e04748","Type":"ContainerStarted","Data":"8bbad9257f2789f2b0165e74cbf70468111e169fabcfb93e39169f9eefbbb62f"}
Jul 21 02:04:16.579383 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.579345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4633258f-49d6-4967-8739-04527475dd1f-cert\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:16.582441 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.582409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4633258f-49d6-4967-8739-04527475dd1f-cert\") pod \"odh-model-controller-7998c67dc4-fzbtc\" (UID: \"4633258f-49d6-4967-8739-04527475dd1f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:16.835135 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:16.835095    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:17.011298 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.011209    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fzbtc"]
Jul 21 02:04:17.015714 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:04:17.015686    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4633258f_49d6_4967_8739_04527475dd1f.slice/crio-336f30fcc99f62422481177b0b82cb95b91e047bd9ed1767de4d2c0c8397991f WatchSource:0}: Error finding container 336f30fcc99f62422481177b0b82cb95b91e047bd9ed1767de4d2c0c8397991f: Status 404 returned error can't find the container with id 336f30fcc99f62422481177b0b82cb95b91e047bd9ed1767de4d2c0c8397991f
Jul 21 02:04:17.376499 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.376462    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc" event={"ID":"4633258f-49d6-4967-8739-04527475dd1f","Type":"ContainerStarted","Data":"336f30fcc99f62422481177b0b82cb95b91e047bd9ed1767de4d2c0c8397991f"}
Jul 21 02:04:17.489961 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.489916    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zltrl"]
Jul 21 02:04:17.493186 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.493155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:17.496164 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.496128    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-vbfz7\""
Jul 21 02:04:17.496548 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.496528    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 02:04:17.505994 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.505913    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zltrl"]
Jul 21 02:04:17.588071 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.588031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clkv8\" (UniqueName: \"kubernetes.io/projected/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-kube-api-access-clkv8\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:17.588258 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.588206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:17.689150 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.689060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:17.689150 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.689131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clkv8\" (UniqueName: \"kubernetes.io/projected/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-kube-api-access-clkv8\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:17.689398 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:17.689325    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 21 02:04:17.689398 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:17.689395    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-tls-certs podName:0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4 nodeName:}" failed. No retries permitted until 2026-07-21 02:04:18.189374587 +0000 UTC m=+625.931180909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-tls-certs") pod "model-serving-api-54d89bd5fc-zltrl" (UID: "0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4") : secret "model-serving-api-tls" not found
Jul 21 02:04:17.705711 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.705398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clkv8\" (UniqueName: \"kubernetes.io/projected/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-kube-api-access-clkv8\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:17.769738 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.769692    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"]
Jul 21 02:04:17.774752 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.774727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.778167 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.778141    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 02:04:17.778318 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.778141    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 02:04:17.778536 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.778519    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 02:04:17.778645 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.778626    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 02:04:17.778980 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.778920    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bh7vm\""
Jul 21 02:04:17.797668 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.797614    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"]
Jul 21 02:04:17.890868 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.890825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.891046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.890879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7t7q\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-kube-api-access-c7t7q\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.891046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.890905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-local-certs\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.891046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.890941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-cacerts\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.891046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.890980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-token\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.891046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.891000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.891046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.891040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992078 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-token\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992289 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992087    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992289 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992289 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992454 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7t7q\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-kube-api-access-c7t7q\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992454 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-local-certs\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.992454 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.992380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-cacerts\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.993228 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.993200    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.997400 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.997354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-cacerts\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.997598 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.997574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-local-certs\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.998124 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.998087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:17.999485 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:17.999412    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:18.003248 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:18.003183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-token\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:18.003465 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:18.003418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7t7q\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-kube-api-access-c7t7q\") pod \"istiod-openshift-gateway-7574459656-qwg42\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:18.090215 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:18.089916    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:18.193551 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:18.193515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:18.196629 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:18.196597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-zltrl\" (UID: \"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:18.408453 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:18.408304    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:20.104366 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.104269    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zltrl"]
Jul 21 02:04:20.107687 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:04:20.107644    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee16ecc_c0f3_44ac_aa4a_68c09a1f12f4.slice/crio-e19604452698462a80ed553e35680ee5a53e810dc3541d46771b261e4eba9975 WatchSource:0}: Error finding container e19604452698462a80ed553e35680ee5a53e810dc3541d46771b261e4eba9975: Status 404 returned error can't find the container with id e19604452698462a80ed553e35680ee5a53e810dc3541d46771b261e4eba9975
Jul 21 02:04:20.136528 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.136500    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"]
Jul 21 02:04:20.137873 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:04:20.137845    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9b20de_93e9_45a0_8a37_9356a0aa9ddb.slice/crio-2cb87d1a1913c21a6db996b896fff3108f41e9f85b3fcc80165a915147c4c392 WatchSource:0}: Error finding container 2cb87d1a1913c21a6db996b896fff3108f41e9f85b3fcc80165a915147c4c392: Status 404 returned error can't find the container with id 2cb87d1a1913c21a6db996b896fff3108f41e9f85b3fcc80165a915147c4c392
Jul 21 02:04:20.399282 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.399228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" event={"ID":"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb","Type":"ContainerStarted","Data":"2cb87d1a1913c21a6db996b896fff3108f41e9f85b3fcc80165a915147c4c392"}
Jul 21 02:04:20.400733 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.400706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r" event={"ID":"1ee0ba38-d648-4ffe-8f17-cad090e04748","Type":"ContainerStarted","Data":"13ee1e4ea3e3a186abcf0692407f073f857e0531552b48804597f8752b366762"}
Jul 21 02:04:20.402101 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.402075    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc" event={"ID":"4633258f-49d6-4967-8739-04527475dd1f","Type":"ContainerStarted","Data":"f34b00a06e11f0bf24d42075898f0c08c8081f2a832e8e71326224839080c44d"}
Jul 21 02:04:20.402195 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.402183    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:20.403124 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.403103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl" event={"ID":"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4","Type":"ContainerStarted","Data":"e19604452698462a80ed553e35680ee5a53e810dc3541d46771b261e4eba9975"}
Jul 21 02:04:20.419840 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:20.419800    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b99b8fb9b-6247r" podStartSLOduration=1.216898622 podStartE2EDuration="5.419785599s" totalImagesPullingTime="4.202886977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:20.418751923 +0000 UTC m=+628.160558253" watchObservedRunningTime="2026-07-21 02:04:20.419785599 +0000 UTC m=+628.161591940"
Jul 21 02:04:22.417293 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:22.417255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl" event={"ID":"0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4","Type":"ContainerStarted","Data":"d70e2ce558976cb2894889ed7edf0d7ff9bfdb5b669eda7bdffa0371801caca0"}
Jul 21 02:04:22.417680 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:22.417381    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:04:22.437181 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:22.437118    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc" podStartSLOduration=4.470315068 podStartE2EDuration="7.437097493s" totalImagesPullingTime="2.966782425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:20.439200459 +0000 UTC m=+628.181006801" watchObservedRunningTime="2026-07-21 02:04:22.437097493 +0000 UTC m=+630.178903838"
Jul 21 02:04:22.438858 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:22.438821    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl" podStartSLOduration=3.625590277 podStartE2EDuration="5.438810801s" totalImagesPullingTime="1.813220524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:22.436567613 +0000 UTC m=+630.178373949" watchObservedRunningTime="2026-07-21 02:04:22.438810801 +0000 UTC m=+630.180617169"
Jul 21 02:04:22.897104 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:22.897056    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 02:04:22.897217 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:22.897130    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 02:04:23.424083 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:23.424040    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" event={"ID":"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb","Type":"ContainerStarted","Data":"0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b"}
Jul 21 02:04:23.424539 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:23.424256    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:23.425925 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:23.425901    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qwg42 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 02:04:23.426046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:23.425943    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" podUID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 02:04:23.464195 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:23.464133    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" podStartSLOduration=3.707204437 podStartE2EDuration="6.464108376s" totalImagesPullingTime="2.756903939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:23.461683836 +0000 UTC m=+631.203490200" watchObservedRunningTime="2026-07-21 02:04:23.464108376 +0000 UTC m=+631.205914718"
Jul 21 02:04:24.430383 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:24.430351    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:26.642948 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.642906    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"]
Jul 21 02:04:26.646958 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.646935    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.647339 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.647309    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"]
Jul 21 02:04:26.649951 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.649886    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lmc4f\""
Jul 21 02:04:26.650082 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.650070    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 02:04:26.651018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.650998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:26.653329 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.653308    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k4dwd\""
Jul 21 02:04:26.653896 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.653870    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 21 02:04:26.661660 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.661632    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"]
Jul 21 02:04:26.682567 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.682531    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"]
Jul 21 02:04:26.776493 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.776460    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5sph\" (UniqueName: \"kubernetes.io/projected/bb330596-015e-4e7b-8640-9ea6c9c83891-kube-api-access-g5sph\") pod \"kserve-controller-manager-d6f4b65b8-94m2r\" (UID: \"bb330596-015e-4e7b-8640-9ea6c9c83891\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.776677 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.776528    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kcv\" (UniqueName: \"kubernetes.io/projected/d1b48bfc-96e1-4d66-85b4-17841b902ff1-kube-api-access-n9kcv\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:26.776677 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.776559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb330596-015e-4e7b-8640-9ea6c9c83891-cert\") pod \"kserve-controller-manager-d6f4b65b8-94m2r\" (UID: \"bb330596-015e-4e7b-8640-9ea6c9c83891\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.776677 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.776648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1b48bfc-96e1-4d66-85b4-17841b902ff1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:26.878002 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.877949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb330596-015e-4e7b-8640-9ea6c9c83891-cert\") pod \"kserve-controller-manager-d6f4b65b8-94m2r\" (UID: \"bb330596-015e-4e7b-8640-9ea6c9c83891\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.878214 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.878040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1b48bfc-96e1-4d66-85b4-17841b902ff1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:26.878214 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.878142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5sph\" (UniqueName: \"kubernetes.io/projected/bb330596-015e-4e7b-8640-9ea6c9c83891-kube-api-access-g5sph\") pod \"kserve-controller-manager-d6f4b65b8-94m2r\" (UID: \"bb330596-015e-4e7b-8640-9ea6c9c83891\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.878214 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.878209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kcv\" (UniqueName: \"kubernetes.io/projected/d1b48bfc-96e1-4d66-85b4-17841b902ff1-kube-api-access-n9kcv\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:26.878473 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:26.878228    2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 21 02:04:26.878581 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:26.878566    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1b48bfc-96e1-4d66-85b4-17841b902ff1-cert podName:d1b48bfc-96e1-4d66-85b4-17841b902ff1 nodeName:}" failed. No retries permitted until 2026-07-21 02:04:27.378544373 +0000 UTC m=+635.120350699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d1b48bfc-96e1-4d66-85b4-17841b902ff1-cert") pod "llmisvc-controller-manager-777c6bd7d5-2p7t7" (UID: "d1b48bfc-96e1-4d66-85b4-17841b902ff1") : secret "llmisvc-webhook-server-cert" not found
Jul 21 02:04:26.880898 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.880862    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb330596-015e-4e7b-8640-9ea6c9c83891-cert\") pod \"kserve-controller-manager-d6f4b65b8-94m2r\" (UID: \"bb330596-015e-4e7b-8640-9ea6c9c83891\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.904221 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.904137    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kcv\" (UniqueName: \"kubernetes.io/projected/d1b48bfc-96e1-4d66-85b4-17841b902ff1-kube-api-access-n9kcv\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:26.906252 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.906209    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5sph\" (UniqueName: \"kubernetes.io/projected/bb330596-015e-4e7b-8640-9ea6c9c83891-kube-api-access-g5sph\") pod \"kserve-controller-manager-d6f4b65b8-94m2r\" (UID: \"bb330596-015e-4e7b-8640-9ea6c9c83891\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:26.960751 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:26.960717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:27.027787 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.027746    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"]
Jul 21 02:04:27.028427 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.028186    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" podUID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" containerName="discovery" containerID="cri-o://0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b" gracePeriod=30
Jul 21 02:04:27.154715 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.154641    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"]
Jul 21 02:04:27.155402 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:04:27.155373    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb330596_015e_4e7b_8640_9ea6c9c83891.slice/crio-a17c63829a3d292c38e12a284ceefc22d545053211ff4ed3aa99589c8f19f6e3 WatchSource:0}: Error finding container a17c63829a3d292c38e12a284ceefc22d545053211ff4ed3aa99589c8f19f6e3: Status 404 returned error can't find the container with id a17c63829a3d292c38e12a284ceefc22d545053211ff4ed3aa99589c8f19f6e3
Jul 21 02:04:27.284608 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.284581    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.383525    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-ca-configmap\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.383918    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.384051    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-kubeconfig\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.384788    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-token\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.384841    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-dns-cert\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.384964    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-cacerts\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.385032    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7t7q\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-kube-api-access-c7t7q\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.385057    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-local-certs\") pod \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\" (UID: \"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb\") "
Jul 21 02:04:27.385836 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.385339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1b48bfc-96e1-4d66-85b4-17841b902ff1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:27.385836 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.385515    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-ca-configmap\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.388342 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.388293    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-local-certs" (OuterVolumeSpecName: "local-certs") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:04:27.388494 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.388388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:04:27.388563 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.388527    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:04:27.388654 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.388625    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1b48bfc-96e1-4d66-85b4-17841b902ff1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2p7t7\" (UID: \"d1b48bfc-96e1-4d66-85b4-17841b902ff1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:27.389016 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.388979    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:04:27.389016 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.389002    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-cacerts" (OuterVolumeSpecName: "cacerts") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:04:27.389687 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.389624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-kube-api-access-c7t7q" (OuterVolumeSpecName: "kube-api-access-c7t7q") pod "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" (UID: "3e9b20de-93e9-45a0-8a37-9356a0aa9ddb"). InnerVolumeSpecName "kube-api-access-c7t7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:04:27.448355 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.448266    2574 generic.go:356] "Generic (PLEG): container finished" podID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" containerID="0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b" exitCode=0
Jul 21 02:04:27.448355 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.448340    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"
Jul 21 02:04:27.448586 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.448360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" event={"ID":"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb","Type":"ContainerDied","Data":"0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b"}
Jul 21 02:04:27.448586 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.448420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwg42" event={"ID":"3e9b20de-93e9-45a0-8a37-9356a0aa9ddb","Type":"ContainerDied","Data":"2cb87d1a1913c21a6db996b896fff3108f41e9f85b3fcc80165a915147c4c392"}
Jul 21 02:04:27.448586 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.448451    2574 scope.go:117] "RemoveContainer" containerID="0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b"
Jul 21 02:04:27.450004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.449970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r" event={"ID":"bb330596-015e-4e7b-8640-9ea6c9c83891","Type":"ContainerStarted","Data":"a17c63829a3d292c38e12a284ceefc22d545053211ff4ed3aa99589c8f19f6e3"}
Jul 21 02:04:27.458805 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.458721    2574 scope.go:117] "RemoveContainer" containerID="0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b"
Jul 21 02:04:27.459018 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:04:27.458998    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b\": container with ID starting with 0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b not found: ID does not exist" containerID="0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b"
Jul 21 02:04:27.459097 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.459031    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b"} err="failed to get container status \"0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b\": rpc error: code = NotFound desc = could not find container \"0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b\": container with ID starting with 0754242446c0a52e5efeb2ae8acfa7928df29ac234b262fb247dcae90d473f8b not found: ID does not exist"
Jul 21 02:04:27.478146 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.478121    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"]
Jul 21 02:04:27.484795 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.484774    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwg42"]
Jul 21 02:04:27.486905 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.486888    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-token\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.486960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.486909    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-csr-dns-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.486960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.486919    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-cacerts\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.486960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.486928    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7t7q\" (UniqueName: \"kubernetes.io/projected/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-kube-api-access-c7t7q\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.486960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.486938    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-local-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.486960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.486945    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb-istio-kubeconfig\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:04:27.567649 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.567614    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:27.711640 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:27.711615    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"]
Jul 21 02:04:27.713415 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:04:27.713384    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1b48bfc_96e1_4d66_85b4_17841b902ff1.slice/crio-6091e070415d06cd5d88fea9e1988ab365b19b46afee547cce07a7f049c453be WatchSource:0}: Error finding container 6091e070415d06cd5d88fea9e1988ab365b19b46afee547cce07a7f049c453be: Status 404 returned error can't find the container with id 6091e070415d06cd5d88fea9e1988ab365b19b46afee547cce07a7f049c453be
Jul 21 02:04:28.458727 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:28.458681    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7" event={"ID":"d1b48bfc-96e1-4d66-85b4-17841b902ff1","Type":"ContainerStarted","Data":"6091e070415d06cd5d88fea9e1988ab365b19b46afee547cce07a7f049c453be"}
Jul 21 02:04:29.023566 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:29.023532    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" path="/var/lib/kubelet/pods/3e9b20de-93e9-45a0-8a37-9356a0aa9ddb/volumes"
Jul 21 02:04:31.423885 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:31.423765    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fzbtc"
Jul 21 02:04:31.486423 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:31.486381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r" event={"ID":"bb330596-015e-4e7b-8640-9ea6c9c83891","Type":"ContainerStarted","Data":"2afe496bb91768575ec09cbeb9f87b6062552546fff64397266acdc9002de204"}
Jul 21 02:04:31.486603 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:31.486554    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:04:31.507000 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:31.506947    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r" podStartSLOduration=2.287297177 podStartE2EDuration="5.506926757s" totalImagesPullingTime="3.21962958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:31.504584399 +0000 UTC m=+639.246390739" watchObservedRunningTime="2026-07-21 02:04:31.506926757 +0000 UTC m=+639.248733099"
Jul 21 02:04:32.492888 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:32.492850    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7" event={"ID":"d1b48bfc-96e1-4d66-85b4-17841b902ff1","Type":"ContainerStarted","Data":"873fa8b7e091defcb2100b897ebc61c0365c16c7bd31fdf352a06094db942c45"}
Jul 21 02:04:32.493302 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:32.493004    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:04:32.510812 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:32.510757    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7" podStartSLOduration=2.5178580139999998 podStartE2EDuration="6.510740756s" totalImagesPullingTime="3.992882742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:32.509620152 +0000 UTC m=+640.251426493" watchObservedRunningTime="2026-07-21 02:04:32.510740756 +0000 UTC m=+640.252547097"
Jul 21 02:04:33.429070 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:04:33.429035    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zltrl"
Jul 21 02:05:02.498273 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:02.498218    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-94m2r"
Jul 21 02:05:03.500060 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:03.500032    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2p7t7"
Jul 21 02:05:16.513649 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.513608    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6gtbl"]
Jul 21 02:05:16.514064 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.513960    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" containerName="discovery"
Jul 21 02:05:16.514064 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.513970    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" containerName="discovery"
Jul 21 02:05:16.514064 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.514032    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9b20de-93e9-45a0-8a37-9356a0aa9ddb" containerName="discovery"
Jul 21 02:05:16.516030 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.516004    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:16.519728 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.519466    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w9wkd\""
Jul 21 02:05:16.520029 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.520004    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 02:05:16.520716 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.520692    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 02:05:16.530716 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.530691    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6gtbl"]
Jul 21 02:05:16.612416 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.612378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nv5\" (UniqueName: \"kubernetes.io/projected/579f7e91-31f6-47be-9ea3-b2cb28e70fff-kube-api-access-p8nv5\") pod \"kuadrant-operator-catalog-6gtbl\" (UID: \"579f7e91-31f6-47be-9ea3-b2cb28e70fff\") " pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:16.712867 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.712825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nv5\" (UniqueName: \"kubernetes.io/projected/579f7e91-31f6-47be-9ea3-b2cb28e70fff-kube-api-access-p8nv5\") pod \"kuadrant-operator-catalog-6gtbl\" (UID: \"579f7e91-31f6-47be-9ea3-b2cb28e70fff\") " pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:16.724007 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.723980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nv5\" (UniqueName: \"kubernetes.io/projected/579f7e91-31f6-47be-9ea3-b2cb28e70fff-kube-api-access-p8nv5\") pod \"kuadrant-operator-catalog-6gtbl\" (UID: \"579f7e91-31f6-47be-9ea3-b2cb28e70fff\") " pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:16.827485 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.827395    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:16.874667 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.874630    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6gtbl"]
Jul 21 02:05:16.959206 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:16.959171    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6gtbl"]
Jul 21 02:05:16.963066 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:16.963038    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579f7e91_31f6_47be_9ea3_b2cb28e70fff.slice/crio-48d5798cdda1107008cec2382486aef0116ada8cfa47a71659211b889fb8b6de WatchSource:0}: Error finding container 48d5798cdda1107008cec2382486aef0116ada8cfa47a71659211b889fb8b6de: Status 404 returned error can't find the container with id 48d5798cdda1107008cec2382486aef0116ada8cfa47a71659211b889fb8b6de
Jul 21 02:05:17.113517 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.113439    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zp28r"]
Jul 21 02:05:17.116193 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.116176    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:17.137975 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.137945    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zp28r"]
Jul 21 02:05:17.217249 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.217198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpjfq\" (UniqueName: \"kubernetes.io/projected/0eb9134e-7914-4f9d-aae2-11410e8c3534-kube-api-access-rpjfq\") pod \"kuadrant-operator-catalog-zp28r\" (UID: \"0eb9134e-7914-4f9d-aae2-11410e8c3534\") " pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:17.318106 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.318068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpjfq\" (UniqueName: \"kubernetes.io/projected/0eb9134e-7914-4f9d-aae2-11410e8c3534-kube-api-access-rpjfq\") pod \"kuadrant-operator-catalog-zp28r\" (UID: \"0eb9134e-7914-4f9d-aae2-11410e8c3534\") " pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:17.327711 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.327679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpjfq\" (UniqueName: \"kubernetes.io/projected/0eb9134e-7914-4f9d-aae2-11410e8c3534-kube-api-access-rpjfq\") pod \"kuadrant-operator-catalog-zp28r\" (UID: \"0eb9134e-7914-4f9d-aae2-11410e8c3534\") " pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:17.425627 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.425542    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:17.559093 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.559064    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zp28r"]
Jul 21 02:05:17.561191 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:17.561161    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb9134e_7914_4f9d_aae2_11410e8c3534.slice/crio-cb1390ebaa5ead3990bd25c419955b7721407d6093dac3e24f6d88f510d8b40f WatchSource:0}: Error finding container cb1390ebaa5ead3990bd25c419955b7721407d6093dac3e24f6d88f510d8b40f: Status 404 returned error can't find the container with id cb1390ebaa5ead3990bd25c419955b7721407d6093dac3e24f6d88f510d8b40f
Jul 21 02:05:17.724140 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.724098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zp28r" event={"ID":"0eb9134e-7914-4f9d-aae2-11410e8c3534","Type":"ContainerStarted","Data":"cb1390ebaa5ead3990bd25c419955b7721407d6093dac3e24f6d88f510d8b40f"}
Jul 21 02:05:17.725379 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:17.725353    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl" event={"ID":"579f7e91-31f6-47be-9ea3-b2cb28e70fff","Type":"ContainerStarted","Data":"48d5798cdda1107008cec2382486aef0116ada8cfa47a71659211b889fb8b6de"}
Jul 21 02:05:19.739286 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:19.739250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zp28r" event={"ID":"0eb9134e-7914-4f9d-aae2-11410e8c3534","Type":"ContainerStarted","Data":"033753366c50517dae7e2504fbad056d87d83aed12dc9fee3ac95e85d7dd81a7"}
Jul 21 02:05:19.740674 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:19.740646    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl" event={"ID":"579f7e91-31f6-47be-9ea3-b2cb28e70fff","Type":"ContainerStarted","Data":"3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252"}
Jul 21 02:05:19.740795 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:19.740739    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl" podUID="579f7e91-31f6-47be-9ea3-b2cb28e70fff" containerName="registry-server" containerID="cri-o://3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252" gracePeriod=2
Jul 21 02:05:19.758282 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:19.758217    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zp28r" podStartSLOduration=0.818054577 podStartE2EDuration="2.758200446s" totalImagesPullingTime="1.940145869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:19.756754865 +0000 UTC m=+687.498561206" watchObservedRunningTime="2026-07-21 02:05:19.758200446 +0000 UTC m=+687.500006788"
Jul 21 02:05:19.773731 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:19.773689    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl" podStartSLOduration=1.234516601 podStartE2EDuration="3.773674014s" totalImagesPullingTime="2.539157413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:19.772920445 +0000 UTC m=+687.514726785" watchObservedRunningTime="2026-07-21 02:05:19.773674014 +0000 UTC m=+687.515480354"
Jul 21 02:05:19.985713 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:19.985687    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:20.040761 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.040687    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8nv5\" (UniqueName: \"kubernetes.io/projected/579f7e91-31f6-47be-9ea3-b2cb28e70fff-kube-api-access-p8nv5\") pod \"579f7e91-31f6-47be-9ea3-b2cb28e70fff\" (UID: \"579f7e91-31f6-47be-9ea3-b2cb28e70fff\") "
Jul 21 02:05:20.042800 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.042778    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579f7e91-31f6-47be-9ea3-b2cb28e70fff-kube-api-access-p8nv5" (OuterVolumeSpecName: "kube-api-access-p8nv5") pod "579f7e91-31f6-47be-9ea3-b2cb28e70fff" (UID: "579f7e91-31f6-47be-9ea3-b2cb28e70fff"). InnerVolumeSpecName "kube-api-access-p8nv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:20.141831 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.141786    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8nv5\" (UniqueName: \"kubernetes.io/projected/579f7e91-31f6-47be-9ea3-b2cb28e70fff-kube-api-access-p8nv5\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:20.747508 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.747471    2574 generic.go:356] "Generic (PLEG): container finished" podID="579f7e91-31f6-47be-9ea3-b2cb28e70fff" containerID="3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252" exitCode=0
Jul 21 02:05:20.748018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.747514    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl"
Jul 21 02:05:20.748018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.747563    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl" event={"ID":"579f7e91-31f6-47be-9ea3-b2cb28e70fff","Type":"ContainerDied","Data":"3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252"}
Jul 21 02:05:20.748018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.747612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6gtbl" event={"ID":"579f7e91-31f6-47be-9ea3-b2cb28e70fff","Type":"ContainerDied","Data":"48d5798cdda1107008cec2382486aef0116ada8cfa47a71659211b889fb8b6de"}
Jul 21 02:05:20.748018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.747633    2574 scope.go:117] "RemoveContainer" containerID="3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252"
Jul 21 02:05:20.757697 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.757680    2574 scope.go:117] "RemoveContainer" containerID="3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252"
Jul 21 02:05:20.757973 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:05:20.757952    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252\": container with ID starting with 3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252 not found: ID does not exist" containerID="3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252"
Jul 21 02:05:20.758042 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.757982    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252"} err="failed to get container status \"3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252\": rpc error: code = NotFound desc = could not find container \"3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252\": container with ID starting with 3a72305d3e621145be23e692e511f34c2e69ce364559202c5e2c1f385226a252 not found: ID does not exist"
Jul 21 02:05:20.769110 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.769086    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6gtbl"]
Jul 21 02:05:20.773770 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:20.773749    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6gtbl"]
Jul 21 02:05:21.022201 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:21.022169    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579f7e91-31f6-47be-9ea3-b2cb28e70fff" path="/var/lib/kubelet/pods/579f7e91-31f6-47be-9ea3-b2cb28e70fff/volumes"
Jul 21 02:05:27.426318 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.426271    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:27.426759 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.426337    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:27.449249 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.449210    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:27.583056 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.583021    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd858f6c6-pjspw"]
Jul 21 02:05:27.583537 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.583515    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579f7e91-31f6-47be-9ea3-b2cb28e70fff" containerName="registry-server"
Jul 21 02:05:27.583657 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.583538    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="579f7e91-31f6-47be-9ea3-b2cb28e70fff" containerName="registry-server"
Jul 21 02:05:27.583657 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.583652    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="579f7e91-31f6-47be-9ea3-b2cb28e70fff" containerName="registry-server"
Jul 21 02:05:27.588689 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.588670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.597804 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.597779    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd858f6c6-pjspw"]
Jul 21 02:05:27.712418 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-trusted-ca-bundle\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.712581 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1734d58b-5bc2-4e34-b58a-da006646cde0-console-serving-cert\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.712581 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s488b\" (UniqueName: \"kubernetes.io/projected/1734d58b-5bc2-4e34-b58a-da006646cde0-kube-api-access-s488b\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.712581 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-service-ca\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.712713 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1734d58b-5bc2-4e34-b58a-da006646cde0-console-oauth-config\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.712713 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-oauth-serving-cert\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.712713 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.712626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-console-config\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.804337 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.804302    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zp28r"
Jul 21 02:05:27.813743 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813715    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-trusted-ca-bundle\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.813874 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1734d58b-5bc2-4e34-b58a-da006646cde0-console-serving-cert\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.813874 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s488b\" (UniqueName: \"kubernetes.io/projected/1734d58b-5bc2-4e34-b58a-da006646cde0-kube-api-access-s488b\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.813874 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-service-ca\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1734d58b-5bc2-4e34-b58a-da006646cde0-console-oauth-config\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-oauth-serving-cert\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.813975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-console-config\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814747 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.814719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-oauth-serving-cert\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814894 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.814728    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-service-ca\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814894 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.814777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-trusted-ca-bundle\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.814894 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.814777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1734d58b-5bc2-4e34-b58a-da006646cde0-console-config\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.816331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.816304    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1734d58b-5bc2-4e34-b58a-da006646cde0-console-oauth-config\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.816458 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.816442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1734d58b-5bc2-4e34-b58a-da006646cde0-console-serving-cert\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.824410 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.824385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s488b\" (UniqueName: \"kubernetes.io/projected/1734d58b-5bc2-4e34-b58a-da006646cde0-kube-api-access-s488b\") pod \"console-6dd858f6c6-pjspw\" (UID: \"1734d58b-5bc2-4e34-b58a-da006646cde0\") " pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:27.900660 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:27.900617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:28.034036 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:28.034009    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd858f6c6-pjspw"]
Jul 21 02:05:28.035990 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:28.035961    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1734d58b_5bc2_4e34_b58a_da006646cde0.slice/crio-80ce3b1afb8dfb55f74a4085d3ca33bcceb10f524999c4f23861ea4a120a4db4 WatchSource:0}: Error finding container 80ce3b1afb8dfb55f74a4085d3ca33bcceb10f524999c4f23861ea4a120a4db4: Status 404 returned error can't find the container with id 80ce3b1afb8dfb55f74a4085d3ca33bcceb10f524999c4f23861ea4a120a4db4
Jul 21 02:05:28.788363 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:28.788323    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd858f6c6-pjspw" event={"ID":"1734d58b-5bc2-4e34-b58a-da006646cde0","Type":"ContainerStarted","Data":"0e56ddc9f0168f18025085ea901e4e807cedb17f42e62e2909287ab3746ee563"}
Jul 21 02:05:28.788762 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:28.788386    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd858f6c6-pjspw" event={"ID":"1734d58b-5bc2-4e34-b58a-da006646cde0","Type":"ContainerStarted","Data":"80ce3b1afb8dfb55f74a4085d3ca33bcceb10f524999c4f23861ea4a120a4db4"}
Jul 21 02:05:28.809152 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:28.809098    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd858f6c6-pjspw" podStartSLOduration=1.809081601 podStartE2EDuration="1.809081601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:28.806853878 +0000 UTC m=+696.548660218" watchObservedRunningTime="2026-07-21 02:05:28.809081601 +0000 UTC m=+696.550887942"
Jul 21 02:05:31.896087 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:31.896050    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"]
Jul 21 02:05:31.899788 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:31.899770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:31.902216 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:31.902195    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tkr4w\""
Jul 21 02:05:31.907409 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:31.907094    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"]
Jul 21 02:05:32.054493 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.054451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.054681 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.054504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdt5c\" (UniqueName: \"kubernetes.io/projected/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-kube-api-access-cdt5c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.054681 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.054647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.155105 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.155021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.155105 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.155088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.155306 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.155128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdt5c\" (UniqueName: \"kubernetes.io/projected/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-kube-api-access-cdt5c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.155472 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.155454    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.155525 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.155506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.164968 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.164949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdt5c\" (UniqueName: \"kubernetes.io/projected/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-kube-api-access-cdt5c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.210061 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.210030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:32.342329 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.342290    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"]
Jul 21 02:05:32.344716 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:32.344687    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eed30d8_c68f_4368_9cbd_ed7963b8d36e.slice/crio-2b3323ced0f9dca5a9783beb8a0489d643d8bb11fb517af23f5c86ec94e57b01 WatchSource:0}: Error finding container 2b3323ced0f9dca5a9783beb8a0489d643d8bb11fb517af23f5c86ec94e57b01: Status 404 returned error can't find the container with id 2b3323ced0f9dca5a9783beb8a0489d643d8bb11fb517af23f5c86ec94e57b01
Jul 21 02:05:32.495630 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.495598    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"]
Jul 21 02:05:32.499442 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.499420    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.507964 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.507938    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"]
Jul 21 02:05:32.660391 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.660351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltrg7\" (UniqueName: \"kubernetes.io/projected/808df566-8874-4900-9d7a-287781ef1f2d-kube-api-access-ltrg7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.660563 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.660401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.660563 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.660462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.761801 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.761759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.762005 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.761856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltrg7\" (UniqueName: \"kubernetes.io/projected/808df566-8874-4900-9d7a-287781ef1f2d-kube-api-access-ltrg7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.762005 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.761890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.762278 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.762221    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.762418 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.762332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.770776 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.770754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltrg7\" (UniqueName: \"kubernetes.io/projected/808df566-8874-4900-9d7a-287781ef1f2d-kube-api-access-ltrg7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.809004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.808971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:32.812985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.812959    2574 generic.go:356] "Generic (PLEG): container finished" podID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerID="0e73b44799331406bf099e90c68d2cfa8cdd16211f046d2cdc71f5eec5be2036" exitCode=0
Jul 21 02:05:32.813075 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.813012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj" event={"ID":"3eed30d8-c68f-4368-9cbd-ed7963b8d36e","Type":"ContainerDied","Data":"0e73b44799331406bf099e90c68d2cfa8cdd16211f046d2cdc71f5eec5be2036"}
Jul 21 02:05:32.813075 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.813045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj" event={"ID":"3eed30d8-c68f-4368-9cbd-ed7963b8d36e","Type":"ContainerStarted","Data":"2b3323ced0f9dca5a9783beb8a0489d643d8bb11fb517af23f5c86ec94e57b01"}
Jul 21 02:05:32.901909 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.901871    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"]
Jul 21 02:05:32.907460 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.907434    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:32.913432 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.913399    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"]
Jul 21 02:05:32.947729 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:32.947706    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"]
Jul 21 02:05:32.949284 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:32.949259    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808df566_8874_4900_9d7a_287781ef1f2d.slice/crio-dcb8b18b33a627c9d9ee6a2b7d331f226a7461567a147d9075569a6de1bfa004 WatchSource:0}: Error finding container dcb8b18b33a627c9d9ee6a2b7d331f226a7461567a147d9075569a6de1bfa004: Status 404 returned error can't find the container with id dcb8b18b33a627c9d9ee6a2b7d331f226a7461567a147d9075569a6de1bfa004
Jul 21 02:05:33.064968 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.064937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.065100 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.065005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.065100 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.065066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6vf\" (UniqueName: \"kubernetes.io/projected/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-kube-api-access-kh6vf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.166018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.165973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.166198 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.166072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.166198 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.166183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6vf\" (UniqueName: \"kubernetes.io/projected/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-kube-api-access-kh6vf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.166516 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.166488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.166747 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.166730    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.175361 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.175335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6vf\" (UniqueName: \"kubernetes.io/projected/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-kube-api-access-kh6vf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.221392 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.221359    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:33.292385 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.292315    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"]
Jul 21 02:05:33.297443 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.297418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.304530 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.304503    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"]
Jul 21 02:05:33.363918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.363892    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"]
Jul 21 02:05:33.365486 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:33.365454    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71bfc75_0dee_4cf5_baf3_ec6a2f17f44a.slice/crio-dcc139c86c1b3d8ae350529f53f677fd6cee3d5c109ccebe6e03f8253837b49d WatchSource:0}: Error finding container dcc139c86c1b3d8ae350529f53f677fd6cee3d5c109ccebe6e03f8253837b49d: Status 404 returned error can't find the container with id dcc139c86c1b3d8ae350529f53f677fd6cee3d5c109ccebe6e03f8253837b49d
Jul 21 02:05:33.468751 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.468722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.468898 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.468784    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.468955 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.468891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz54p\" (UniqueName: \"kubernetes.io/projected/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-kube-api-access-mz54p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.569988 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.569909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.569988 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.569959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.570174 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.569990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz54p\" (UniqueName: \"kubernetes.io/projected/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-kube-api-access-mz54p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.570371 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.570349    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.570411 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.570396    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.578358 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.578333    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz54p\" (UniqueName: \"kubernetes.io/projected/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-kube-api-access-mz54p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.608909 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.608886    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:33.739004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.738977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"]
Jul 21 02:05:33.740850 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:33.740810    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9cc202_3ffb_466e_84b9_abc113f2f3b2.slice/crio-d772ac72768300abd9edfd60c9787ca32950c369dc21219c7e98463a82d7cf3e WatchSource:0}: Error finding container d772ac72768300abd9edfd60c9787ca32950c369dc21219c7e98463a82d7cf3e: Status 404 returned error can't find the container with id d772ac72768300abd9edfd60c9787ca32950c369dc21219c7e98463a82d7cf3e
Jul 21 02:05:33.821317 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.821206    2574 generic.go:356] "Generic (PLEG): container finished" podID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerID="aad59499eae2e338b9ef0d1c7a3e786c430450d7eed14b78efcb8568f8566573" exitCode=0
Jul 21 02:05:33.821317 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.821279    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv" event={"ID":"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a","Type":"ContainerDied","Data":"aad59499eae2e338b9ef0d1c7a3e786c430450d7eed14b78efcb8568f8566573"}
Jul 21 02:05:33.821546 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.821340    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv" event={"ID":"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a","Type":"ContainerStarted","Data":"dcc139c86c1b3d8ae350529f53f677fd6cee3d5c109ccebe6e03f8253837b49d"}
Jul 21 02:05:33.823084 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.823052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx" event={"ID":"cc9cc202-3ffb-466e-84b9-abc113f2f3b2","Type":"ContainerStarted","Data":"a56be90164677e4883c49b24d5c37c261cba20bf44fce665ae74de8fb06c6f33"}
Jul 21 02:05:33.823201 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.823104    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx" event={"ID":"cc9cc202-3ffb-466e-84b9-abc113f2f3b2","Type":"ContainerStarted","Data":"d772ac72768300abd9edfd60c9787ca32950c369dc21219c7e98463a82d7cf3e"}
Jul 21 02:05:33.824869 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.824834    2574 generic.go:356] "Generic (PLEG): container finished" podID="808df566-8874-4900-9d7a-287781ef1f2d" containerID="2c67a516eb54700af5f05adf8fcc48ab43f249986dac5dfd4b79b2f856ee1d3a" exitCode=0
Jul 21 02:05:33.824985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.824883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8" event={"ID":"808df566-8874-4900-9d7a-287781ef1f2d","Type":"ContainerDied","Data":"2c67a516eb54700af5f05adf8fcc48ab43f249986dac5dfd4b79b2f856ee1d3a"}
Jul 21 02:05:33.824985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:33.824921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8" event={"ID":"808df566-8874-4900-9d7a-287781ef1f2d","Type":"ContainerStarted","Data":"dcb8b18b33a627c9d9ee6a2b7d331f226a7461567a147d9075569a6de1bfa004"}
Jul 21 02:05:34.832137 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:34.832099    2574 generic.go:356] "Generic (PLEG): container finished" podID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerID="f893569db6abb65a0a2a5a87ef64bee74a2063a485dfd7297bec01f8aca127b9" exitCode=0
Jul 21 02:05:34.832586 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:34.832172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj" event={"ID":"3eed30d8-c68f-4368-9cbd-ed7963b8d36e","Type":"ContainerDied","Data":"f893569db6abb65a0a2a5a87ef64bee74a2063a485dfd7297bec01f8aca127b9"}
Jul 21 02:05:34.833725 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:34.833698    2574 generic.go:356] "Generic (PLEG): container finished" podID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerID="a56be90164677e4883c49b24d5c37c261cba20bf44fce665ae74de8fb06c6f33" exitCode=0
Jul 21 02:05:34.833890 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:34.833769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx" event={"ID":"cc9cc202-3ffb-466e-84b9-abc113f2f3b2","Type":"ContainerDied","Data":"a56be90164677e4883c49b24d5c37c261cba20bf44fce665ae74de8fb06c6f33"}
Jul 21 02:05:35.842129 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:35.842098    2574 generic.go:356] "Generic (PLEG): container finished" podID="808df566-8874-4900-9d7a-287781ef1f2d" containerID="4dbf3c150d397ec8f9f9dd0b96aab2ce8c751900eaf7edda722a5a5b2056e971" exitCode=0
Jul 21 02:05:35.842457 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:35.842188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8" event={"ID":"808df566-8874-4900-9d7a-287781ef1f2d","Type":"ContainerDied","Data":"4dbf3c150d397ec8f9f9dd0b96aab2ce8c751900eaf7edda722a5a5b2056e971"}
Jul 21 02:05:35.844345 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:35.844317    2574 generic.go:356] "Generic (PLEG): container finished" podID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerID="a1b569563636295cbce846fec7410444e0b90cf0dad07b27664aee094a62b5aa" exitCode=0
Jul 21 02:05:35.844439 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:35.844391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj" event={"ID":"3eed30d8-c68f-4368-9cbd-ed7963b8d36e","Type":"ContainerDied","Data":"a1b569563636295cbce846fec7410444e0b90cf0dad07b27664aee094a62b5aa"}
Jul 21 02:05:35.846057 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:35.846038    2574 generic.go:356] "Generic (PLEG): container finished" podID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerID="48eaeaef0cf263f86245f83c587e9c4b4d82cec714449de907c11ec80518b894" exitCode=0
Jul 21 02:05:35.846152 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:35.846122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv" event={"ID":"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a","Type":"ContainerDied","Data":"48eaeaef0cf263f86245f83c587e9c4b4d82cec714449de907c11ec80518b894"}
Jul 21 02:05:36.853472 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.853382    2574 generic.go:356] "Generic (PLEG): container finished" podID="808df566-8874-4900-9d7a-287781ef1f2d" containerID="ffef02200e1f60c6e913122183a0824b985b013975d7d334b09c7fc6c2d941c0" exitCode=0
Jul 21 02:05:36.853910 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.853467    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8" event={"ID":"808df566-8874-4900-9d7a-287781ef1f2d","Type":"ContainerDied","Data":"ffef02200e1f60c6e913122183a0824b985b013975d7d334b09c7fc6c2d941c0"}
Jul 21 02:05:36.855604 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.855582    2574 generic.go:356] "Generic (PLEG): container finished" podID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerID="ae81624bd8b7ba19b521df602ba73f82b0fdb1834d29171bf07979c72004b51f" exitCode=0
Jul 21 02:05:36.855705 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.855663    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv" event={"ID":"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a","Type":"ContainerDied","Data":"ae81624bd8b7ba19b521df602ba73f82b0fdb1834d29171bf07979c72004b51f"}
Jul 21 02:05:36.857494 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.857470    2574 generic.go:356] "Generic (PLEG): container finished" podID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerID="a5a0f6e7fea1fa1f832736ce34e24e93678878fb9ef05aaff8bcb3f74273c33a" exitCode=0
Jul 21 02:05:36.857591 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.857551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx" event={"ID":"cc9cc202-3ffb-466e-84b9-abc113f2f3b2","Type":"ContainerDied","Data":"a5a0f6e7fea1fa1f832736ce34e24e93678878fb9ef05aaff8bcb3f74273c33a"}
Jul 21 02:05:36.998345 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:36.998320    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:37.101597 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.101561    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-bundle\") pod \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") "
Jul 21 02:05:37.101774 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.101647    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-util\") pod \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") "
Jul 21 02:05:37.101774 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.101704    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdt5c\" (UniqueName: \"kubernetes.io/projected/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-kube-api-access-cdt5c\") pod \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\" (UID: \"3eed30d8-c68f-4368-9cbd-ed7963b8d36e\") "
Jul 21 02:05:37.102163 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.102131    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-bundle" (OuterVolumeSpecName: "bundle") pod "3eed30d8-c68f-4368-9cbd-ed7963b8d36e" (UID: "3eed30d8-c68f-4368-9cbd-ed7963b8d36e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:37.103889 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.103836    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-kube-api-access-cdt5c" (OuterVolumeSpecName: "kube-api-access-cdt5c") pod "3eed30d8-c68f-4368-9cbd-ed7963b8d36e" (UID: "3eed30d8-c68f-4368-9cbd-ed7963b8d36e"). InnerVolumeSpecName "kube-api-access-cdt5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:37.107498 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.107473    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-util" (OuterVolumeSpecName: "util") pod "3eed30d8-c68f-4368-9cbd-ed7963b8d36e" (UID: "3eed30d8-c68f-4368-9cbd-ed7963b8d36e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:37.202636 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.202603    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:37.202636 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.202629    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdt5c\" (UniqueName: \"kubernetes.io/projected/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-kube-api-access-cdt5c\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:37.202636 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.202639    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eed30d8-c68f-4368-9cbd-ed7963b8d36e-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:37.864567 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.864484    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj"
Jul 21 02:05:37.864567 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.864501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj" event={"ID":"3eed30d8-c68f-4368-9cbd-ed7963b8d36e","Type":"ContainerDied","Data":"2b3323ced0f9dca5a9783beb8a0489d643d8bb11fb517af23f5c86ec94e57b01"}
Jul 21 02:05:37.864567 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.864549    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b3323ced0f9dca5a9783beb8a0489d643d8bb11fb517af23f5c86ec94e57b01"
Jul 21 02:05:37.866569 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.866542    2574 generic.go:356] "Generic (PLEG): container finished" podID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerID="356ec0538c7fb974fa4daad489667a0b2ceb048d3ac4d03e8ac267d149f57dc6" exitCode=0
Jul 21 02:05:37.866708 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.866613    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx" event={"ID":"cc9cc202-3ffb-466e-84b9-abc113f2f3b2","Type":"ContainerDied","Data":"356ec0538c7fb974fa4daad489667a0b2ceb048d3ac4d03e8ac267d149f57dc6"}
Jul 21 02:05:37.901447 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.901411    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:37.901599 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.901478    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:37.906820 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:37.906791    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:38.025201 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.025172    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:38.051432 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.051406    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:38.120521 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.120450    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-bundle\") pod \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") "
Jul 21 02:05:38.120521 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.120484    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-util\") pod \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") "
Jul 21 02:05:38.120521 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.120517    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh6vf\" (UniqueName: \"kubernetes.io/projected/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-kube-api-access-kh6vf\") pod \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\" (UID: \"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a\") "
Jul 21 02:05:38.121108 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.121070    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-bundle" (OuterVolumeSpecName: "bundle") pod "d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" (UID: "d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:38.122647 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.122628    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-kube-api-access-kh6vf" (OuterVolumeSpecName: "kube-api-access-kh6vf") pod "d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" (UID: "d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a"). InnerVolumeSpecName "kube-api-access-kh6vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:38.126190 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.126148    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-util" (OuterVolumeSpecName: "util") pod "d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" (UID: "d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:38.221354 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221318    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-bundle\") pod \"808df566-8874-4900-9d7a-287781ef1f2d\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") "
Jul 21 02:05:38.221527 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221416    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltrg7\" (UniqueName: \"kubernetes.io/projected/808df566-8874-4900-9d7a-287781ef1f2d-kube-api-access-ltrg7\") pod \"808df566-8874-4900-9d7a-287781ef1f2d\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") "
Jul 21 02:05:38.221527 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221472    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-util\") pod \"808df566-8874-4900-9d7a-287781ef1f2d\" (UID: \"808df566-8874-4900-9d7a-287781ef1f2d\") "
Jul 21 02:05:38.221747 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221727    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:38.221821 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221750    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:38.221821 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221763    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh6vf\" (UniqueName: \"kubernetes.io/projected/d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a-kube-api-access-kh6vf\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:38.221894 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.221851    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-bundle" (OuterVolumeSpecName: "bundle") pod "808df566-8874-4900-9d7a-287781ef1f2d" (UID: "808df566-8874-4900-9d7a-287781ef1f2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:38.223520 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.223495    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808df566-8874-4900-9d7a-287781ef1f2d-kube-api-access-ltrg7" (OuterVolumeSpecName: "kube-api-access-ltrg7") pod "808df566-8874-4900-9d7a-287781ef1f2d" (UID: "808df566-8874-4900-9d7a-287781ef1f2d"). InnerVolumeSpecName "kube-api-access-ltrg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:38.227013 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.226989    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-util" (OuterVolumeSpecName: "util") pod "808df566-8874-4900-9d7a-287781ef1f2d" (UID: "808df566-8874-4900-9d7a-287781ef1f2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:38.322305 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.322264    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:38.322305 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.322305    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/808df566-8874-4900-9d7a-287781ef1f2d-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:38.322480 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.322318    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltrg7\" (UniqueName: \"kubernetes.io/projected/808df566-8874-4900-9d7a-287781ef1f2d-kube-api-access-ltrg7\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:38.874742 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.874667    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8"
Jul 21 02:05:38.874742 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.874688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8" event={"ID":"808df566-8874-4900-9d7a-287781ef1f2d","Type":"ContainerDied","Data":"dcb8b18b33a627c9d9ee6a2b7d331f226a7461567a147d9075569a6de1bfa004"}
Jul 21 02:05:38.874742 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.874733    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcb8b18b33a627c9d9ee6a2b7d331f226a7461567a147d9075569a6de1bfa004"
Jul 21 02:05:38.876656 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.876633    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv"
Jul 21 02:05:38.876792 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.876661    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv" event={"ID":"d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a","Type":"ContainerDied","Data":"dcc139c86c1b3d8ae350529f53f677fd6cee3d5c109ccebe6e03f8253837b49d"}
Jul 21 02:05:38.876792 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.876707    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcc139c86c1b3d8ae350529f53f677fd6cee3d5c109ccebe6e03f8253837b49d"
Jul 21 02:05:38.881064 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.881043    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd858f6c6-pjspw"
Jul 21 02:05:38.944288 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:38.944253    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7765cc9f69-s2qwz"]
Jul 21 02:05:39.039043 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.038381    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:39.129157 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.129079    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-util\") pod \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") "
Jul 21 02:05:39.129320 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.129180    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-bundle\") pod \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") "
Jul 21 02:05:39.129320 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.129260    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz54p\" (UniqueName: \"kubernetes.io/projected/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-kube-api-access-mz54p\") pod \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\" (UID: \"cc9cc202-3ffb-466e-84b9-abc113f2f3b2\") "
Jul 21 02:05:39.129697 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.129666    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-bundle" (OuterVolumeSpecName: "bundle") pod "cc9cc202-3ffb-466e-84b9-abc113f2f3b2" (UID: "cc9cc202-3ffb-466e-84b9-abc113f2f3b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:39.131350 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.131319    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-kube-api-access-mz54p" (OuterVolumeSpecName: "kube-api-access-mz54p") pod "cc9cc202-3ffb-466e-84b9-abc113f2f3b2" (UID: "cc9cc202-3ffb-466e-84b9-abc113f2f3b2"). InnerVolumeSpecName "kube-api-access-mz54p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:39.133619 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.133581    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-util" (OuterVolumeSpecName: "util") pod "cc9cc202-3ffb-466e-84b9-abc113f2f3b2" (UID: "cc9cc202-3ffb-466e-84b9-abc113f2f3b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:39.230825 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.230791    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-util\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:39.230825 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.230821    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:39.230825 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.230832    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz54p\" (UniqueName: \"kubernetes.io/projected/cc9cc202-3ffb-466e-84b9-abc113f2f3b2-kube-api-access-mz54p\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:05:39.884090 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.884064    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx"
Jul 21 02:05:39.884593 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.884098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx" event={"ID":"cc9cc202-3ffb-466e-84b9-abc113f2f3b2","Type":"ContainerDied","Data":"d772ac72768300abd9edfd60c9787ca32950c369dc21219c7e98463a82d7cf3e"}
Jul 21 02:05:39.884593 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:39.884149    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d772ac72768300abd9edfd60c9787ca32950c369dc21219c7e98463a82d7cf3e"
Jul 21 02:05:47.866982 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.866902    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"]
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867272    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="extract"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867284    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="extract"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867295    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="extract"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867300    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="extract"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867312    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="pull"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867318    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="pull"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867324    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="extract"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867329    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="extract"
Jul 21 02:05:47.867331 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867336    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867341    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867347    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="pull"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867352    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="pull"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867366    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="pull"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867370    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="pull"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867378    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867383    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867390    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867395    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867399    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="extract"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867404    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="extract"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867412    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="pull"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867418    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="pull"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867424    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867429    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="util"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867483    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eed30d8-c68f-4368-9cbd-ed7963b8d36e" containerName="extract"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867493    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a" containerName="extract"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867501    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9cc202-3ffb-466e-84b9-abc113f2f3b2" containerName="extract"
Jul 21 02:05:47.867740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.867507    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="808df566-8874-4900-9d7a-287781ef1f2d" containerName="extract"
Jul 21 02:05:47.870461 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.870444    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:05:47.874838 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.874812    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qg52b\""
Jul 21 02:05:47.875352 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.875335    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 02:05:47.886420 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.886396    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"]
Jul 21 02:05:47.901124 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:47.901098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229x5\" (UniqueName: \"kubernetes.io/projected/6a2724ea-ceb2-491e-9854-5bfbc9683228-kube-api-access-229x5\") pod \"dns-operator-controller-manager-864dd78c4c-6hqfx\" (UID: \"6a2724ea-ceb2-491e-9854-5bfbc9683228\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:05:48.002153 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:48.002115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229x5\" (UniqueName: \"kubernetes.io/projected/6a2724ea-ceb2-491e-9854-5bfbc9683228-kube-api-access-229x5\") pod \"dns-operator-controller-manager-864dd78c4c-6hqfx\" (UID: \"6a2724ea-ceb2-491e-9854-5bfbc9683228\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:05:48.019419 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:48.019392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229x5\" (UniqueName: \"kubernetes.io/projected/6a2724ea-ceb2-491e-9854-5bfbc9683228-kube-api-access-229x5\") pod \"dns-operator-controller-manager-864dd78c4c-6hqfx\" (UID: \"6a2724ea-ceb2-491e-9854-5bfbc9683228\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:05:48.180369 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:48.180269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:05:48.315197 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:48.315164    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"]
Jul 21 02:05:48.316567 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:48.316541    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2724ea_ceb2_491e_9854_5bfbc9683228.slice/crio-658f98f8daf725894750f4aaab2d3d007bfc57e27d872253b95631201382d27d WatchSource:0}: Error finding container 658f98f8daf725894750f4aaab2d3d007bfc57e27d872253b95631201382d27d: Status 404 returned error can't find the container with id 658f98f8daf725894750f4aaab2d3d007bfc57e27d872253b95631201382d27d
Jul 21 02:05:48.934866 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:48.934825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx" event={"ID":"6a2724ea-ceb2-491e-9854-5bfbc9683228","Type":"ContainerStarted","Data":"658f98f8daf725894750f4aaab2d3d007bfc57e27d872253b95631201382d27d"}
Jul 21 02:05:50.947573 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:50.947538    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx" event={"ID":"6a2724ea-ceb2-491e-9854-5bfbc9683228","Type":"ContainerStarted","Data":"6fae3fbc07264c2ac322147abef393463dac917ea0ed02ef992403682ba9fc70"}
Jul 21 02:05:50.948052 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:50.947658    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:05:50.967061 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:50.967008    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx" podStartSLOduration=1.493299353 podStartE2EDuration="3.966991258s" totalImagesPullingTime="2.473691905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:50.964631385 +0000 UTC m=+718.706437727" watchObservedRunningTime="2026-07-21 02:05:50.966991258 +0000 UTC m=+718.708797599"
Jul 21 02:05:53.275824 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.275788    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"]
Jul 21 02:05:53.279432 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.279414    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.285135 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.285111    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-86p6b\""
Jul 21 02:05:53.297422 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.297395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"]
Jul 21 02:05:53.352090 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.352057    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6cx\" (UniqueName: \"kubernetes.io/projected/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-kube-api-access-8t6cx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.352277 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.352114    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.452885 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.452844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.453049 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.453014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6cx\" (UniqueName: \"kubernetes.io/projected/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-kube-api-access-8t6cx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.453292 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.453274    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.464317 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.464291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6cx\" (UniqueName: \"kubernetes.io/projected/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-kube-api-access-8t6cx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.589537 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.589454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:05:53.746532 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.746501    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"]
Jul 21 02:05:53.752516 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:53.752484    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dd071e_e3f2_4093_98a2_a1e3b49b538d.slice/crio-33c5b88a2aa60e7b7ac1b8053d1b48f29b4ed2c86decc8fd3dffdb6b1b53f0c3 WatchSource:0}: Error finding container 33c5b88a2aa60e7b7ac1b8053d1b48f29b4ed2c86decc8fd3dffdb6b1b53f0c3: Status 404 returned error can't find the container with id 33c5b88a2aa60e7b7ac1b8053d1b48f29b4ed2c86decc8fd3dffdb6b1b53f0c3
Jul 21 02:05:53.965816 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:53.965780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j" event={"ID":"f1dd071e-e3f2-4093-98a2-a1e3b49b538d","Type":"ContainerStarted","Data":"33c5b88a2aa60e7b7ac1b8053d1b48f29b4ed2c86decc8fd3dffdb6b1b53f0c3"}
Jul 21 02:05:56.219858 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.219819    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"]
Jul 21 02:05:56.223568 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.223545    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:05:56.226208 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.226184    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-45g7z\""
Jul 21 02:05:56.235567 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.235514    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"]
Jul 21 02:05:56.277336 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.277280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2htg\" (UniqueName: \"kubernetes.io/projected/3533f52b-6b01-4f56-8dbb-6e743a813168-kube-api-access-c2htg\") pod \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" (UID: \"3533f52b-6b01-4f56-8dbb-6e743a813168\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:05:56.378279 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.378211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2htg\" (UniqueName: \"kubernetes.io/projected/3533f52b-6b01-4f56-8dbb-6e743a813168-kube-api-access-c2htg\") pod \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" (UID: \"3533f52b-6b01-4f56-8dbb-6e743a813168\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:05:56.387532 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.387504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2htg\" (UniqueName: \"kubernetes.io/projected/3533f52b-6b01-4f56-8dbb-6e743a813168-kube-api-access-c2htg\") pod \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" (UID: \"3533f52b-6b01-4f56-8dbb-6e743a813168\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:05:56.538522 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.538420    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:05:56.679029 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.678997    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"]
Jul 21 02:05:56.680648 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:05:56.680622    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3533f52b_6b01_4f56_8dbb_6e743a813168.slice/crio-7bf796a3714a4e72d5c9e4283bce8fe4c23efdda9b379f56ce78782d4a41cd0f WatchSource:0}: Error finding container 7bf796a3714a4e72d5c9e4283bce8fe4c23efdda9b379f56ce78782d4a41cd0f: Status 404 returned error can't find the container with id 7bf796a3714a4e72d5c9e4283bce8fe4c23efdda9b379f56ce78782d4a41cd0f
Jul 21 02:05:56.984253 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:56.984196    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g" event={"ID":"3533f52b-6b01-4f56-8dbb-6e743a813168","Type":"ContainerStarted","Data":"7bf796a3714a4e72d5c9e4283bce8fe4c23efdda9b379f56ce78782d4a41cd0f"}
Jul 21 02:05:58.999621 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:58.999585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g" event={"ID":"3533f52b-6b01-4f56-8dbb-6e743a813168","Type":"ContainerStarted","Data":"339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e"}
Jul 21 02:05:59.000017 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:58.999709    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:05:59.034493 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.034260    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g" podStartSLOduration=1.269623465 podStartE2EDuration="3.034216971s" totalImagesPullingTime="1.764593506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:59.0331982 +0000 UTC m=+726.775004544" watchObservedRunningTime="2026-07-21 02:05:59.034216971 +0000 UTC m=+726.776023290"
Jul 21 02:05:59.539759 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.539718    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"]
Jul 21 02:05:59.544149 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.544122    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:05:59.547116 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.547092    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2hjpp\""
Jul 21 02:05:59.553995 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.553962    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"]
Jul 21 02:05:59.608129 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.608079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nts9\" (UniqueName: \"kubernetes.io/projected/3ddcedbe-c31f-424c-8671-2fad59cc7a93-kube-api-access-6nts9\") pod \"authorino-operator-75cc8d5cb7-qhjwk\" (UID: \"3ddcedbe-c31f-424c-8671-2fad59cc7a93\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:05:59.709390 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.709314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nts9\" (UniqueName: \"kubernetes.io/projected/3ddcedbe-c31f-424c-8671-2fad59cc7a93-kube-api-access-6nts9\") pod \"authorino-operator-75cc8d5cb7-qhjwk\" (UID: \"3ddcedbe-c31f-424c-8671-2fad59cc7a93\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:05:59.719780 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.719752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nts9\" (UniqueName: \"kubernetes.io/projected/3ddcedbe-c31f-424c-8671-2fad59cc7a93-kube-api-access-6nts9\") pod \"authorino-operator-75cc8d5cb7-qhjwk\" (UID: \"3ddcedbe-c31f-424c-8671-2fad59cc7a93\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:05:59.858532 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:05:59.858441    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:06:00.288436 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:00.288415    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"]
Jul 21 02:06:00.290612 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:06:00.290589    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddcedbe_c31f_424c_8671_2fad59cc7a93.slice/crio-03c44335b1f0de8e2e60bbe2271a8ff2c3c149269ea062349feae1319e544a72 WatchSource:0}: Error finding container 03c44335b1f0de8e2e60bbe2271a8ff2c3c149269ea062349feae1319e544a72: Status 404 returned error can't find the container with id 03c44335b1f0de8e2e60bbe2271a8ff2c3c149269ea062349feae1319e544a72
Jul 21 02:06:01.013034 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:01.012990    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j" event={"ID":"f1dd071e-e3f2-4093-98a2-a1e3b49b538d","Type":"ContainerStarted","Data":"974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab"}
Jul 21 02:06:01.013260 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:01.013058    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:01.014313 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:01.014284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk" event={"ID":"3ddcedbe-c31f-424c-8671-2fad59cc7a93","Type":"ContainerStarted","Data":"03c44335b1f0de8e2e60bbe2271a8ff2c3c149269ea062349feae1319e544a72"}
Jul 21 02:06:01.955928 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:01.955897    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6hqfx"
Jul 21 02:06:01.975862 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:01.975802    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j" podStartSLOduration=2.513629358 podStartE2EDuration="8.975779345s" totalImagesPullingTime="6.462149987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:01.033491025 +0000 UTC m=+728.775297366" watchObservedRunningTime="2026-07-21 02:06:01.975779345 +0000 UTC m=+729.717585702"
Jul 21 02:06:03.973738 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:03.973673    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7765cc9f69-s2qwz" podUID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" containerName="console" containerID="cri-o://62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91" gracePeriod=15
Jul 21 02:06:04.035924 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.035888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk" event={"ID":"3ddcedbe-c31f-424c-8671-2fad59cc7a93","Type":"ContainerStarted","Data":"93a1f44edf99dd09e56b8295eb610092cc8316d1e22fc89a3f474aac5f2f4c83"}
Jul 21 02:06:04.036121 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.035981    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:06:04.058399 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.058349    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk" podStartSLOduration=2.163070691 podStartE2EDuration="5.058333972s" totalImagesPullingTime="2.895263281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:04.053819111 +0000 UTC m=+731.795625451" watchObservedRunningTime="2026-07-21 02:06:04.058333972 +0000 UTC m=+731.800140313"
Jul 21 02:06:04.230480 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.230415    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:06:04.352256 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352191    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-oauth-config\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352256 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352265    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-service-ca\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352508 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352491    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlvrn\" (UniqueName: \"kubernetes.io/projected/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-kube-api-access-jlvrn\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352569 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352523    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-config\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352569 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352545    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-trusted-ca-bundle\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352569 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352565    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-serving-cert\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352739 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352632    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-oauth-serving-cert\") pod \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\" (UID: \"8e7bcd14-d4a2-454c-87cd-6688f4f4303b\") "
Jul 21 02:06:04.352844 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352820    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:06:04.352967 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352950    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:04.353030 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.352951    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-config" (OuterVolumeSpecName: "console-config") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:06:04.353084 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.353052    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:06:04.353137 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.353099    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:06:04.354584 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.354556    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:06:04.354584 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.354562    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-kube-api-access-jlvrn" (OuterVolumeSpecName: "kube-api-access-jlvrn") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "kube-api-access-jlvrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:04.354771 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.354753    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e7bcd14-d4a2-454c-87cd-6688f4f4303b" (UID: "8e7bcd14-d4a2-454c-87cd-6688f4f4303b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:06:04.453774 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.453732    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-oauth-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:04.453774 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.453766    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-oauth-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:04.453774 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.453776    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlvrn\" (UniqueName: \"kubernetes.io/projected/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-kube-api-access-jlvrn\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:04.453774 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.453785    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:04.454055 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.453794    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-trusted-ca-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:04.454055 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:04.453802    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7bcd14-d4a2-454c-87cd-6688f4f4303b-console-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:05.043163 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.043129    2574 generic.go:356] "Generic (PLEG): container finished" podID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" containerID="62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91" exitCode=0
Jul 21 02:06:05.043645 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.043176    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7765cc9f69-s2qwz"
Jul 21 02:06:05.043645 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.043225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7765cc9f69-s2qwz" event={"ID":"8e7bcd14-d4a2-454c-87cd-6688f4f4303b","Type":"ContainerDied","Data":"62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91"}
Jul 21 02:06:05.043645 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.043298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7765cc9f69-s2qwz" event={"ID":"8e7bcd14-d4a2-454c-87cd-6688f4f4303b","Type":"ContainerDied","Data":"d19ccf18cff578089f999b00c4dd50b5863a5c831c6b6ae7222a5658cfa5604d"}
Jul 21 02:06:05.043645 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.043331    2574 scope.go:117] "RemoveContainer" containerID="62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91"
Jul 21 02:06:05.052720 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.052699    2574 scope.go:117] "RemoveContainer" containerID="62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91"
Jul 21 02:06:05.053008 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:05.052986    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91\": container with ID starting with 62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91 not found: ID does not exist" containerID="62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91"
Jul 21 02:06:05.053078 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.053023    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91"} err="failed to get container status \"62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91\": rpc error: code = NotFound desc = could not find container \"62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91\": container with ID starting with 62aa323140e90b6c78ea79d9f3f429a52a65ce0ef9621610d6ae3add3b500c91 not found: ID does not exist"
Jul 21 02:06:05.062325 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.062284    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7765cc9f69-s2qwz"]
Jul 21 02:06:05.067795 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:05.067770    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7765cc9f69-s2qwz"]
Jul 21 02:06:07.021645 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:07.021611    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" path="/var/lib/kubelet/pods/8e7bcd14-d4a2-454c-87cd-6688f4f4303b/volumes"
Jul 21 02:06:10.009066 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:10.009030    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:12.023897 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:12.023863    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.616014 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.615975    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"]
Jul 21 02:06:13.616508 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.616148    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" containerName="manager" containerID="cri-o://974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab" gracePeriod=2
Jul 21 02:06:13.632493 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.632458    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"]
Jul 21 02:06:13.635493 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.635450    2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.651836 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.651807    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"]
Jul 21 02:06:13.652003 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.651977    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" containerName="manager" containerID="cri-o://339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e" gracePeriod=2
Jul 21 02:06:13.654316 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.654288    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"]
Jul 21 02:06:13.654829 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.654809    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" containerName="manager"
Jul 21 02:06:13.654969 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.654954    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" containerName="manager"
Jul 21 02:06:13.655118 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.655103    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" containerName="console"
Jul 21 02:06:13.655210 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.655200    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" containerName="console"
Jul 21 02:06:13.655394 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.655377    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" containerName="manager"
Jul 21 02:06:13.655473 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.655398    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e7bcd14-d4a2-454c-87cd-6688f4f4303b" containerName="console"
Jul 21 02:06:13.658503 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.658483    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.674510 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.674435    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"]
Jul 21 02:06:13.674660 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.674551    2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3533f52b-6b01-4f56-8dbb-6e743a813168\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-hsq7g\": pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:13.676753 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.676725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"]
Jul 21 02:06:13.677423 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.677396    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.679538 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.679509    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.686762 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.686738    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"]
Jul 21 02:06:13.687282 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.687262    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" containerName="manager"
Jul 21 02:06:13.687282 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.687284    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" containerName="manager"
Jul 21 02:06:13.687450 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.687404    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" containerName="manager"
Jul 21 02:06:13.690902 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.690884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:13.701116 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.701064    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"]
Jul 21 02:06:13.708529 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.708502    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:13.710789 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.710755    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:13.712936 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.712914    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.734032 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.734005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72qd9\" (UniqueName: \"kubernetes.io/projected/2c950ebe-1cfa-436c-88bc-bde70594ff67-kube-api-access-72qd9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qb7fs\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.734151 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.734060    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkx5p\" (UniqueName: \"kubernetes.io/projected/e7547401-3b87-4a4b-8f4e-8177c9ea20b7-kube-api-access-lkx5p\") pod \"limitador-operator-controller-manager-859d7b78bd-jrr58\" (UID: \"e7547401-3b87-4a4b-8f4e-8177c9ea20b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:13.734151 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.734081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c950ebe-1cfa-436c-88bc-bde70594ff67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qb7fs\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.834874 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.834843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72qd9\" (UniqueName: \"kubernetes.io/projected/2c950ebe-1cfa-436c-88bc-bde70594ff67-kube-api-access-72qd9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qb7fs\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.835018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.834925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkx5p\" (UniqueName: \"kubernetes.io/projected/e7547401-3b87-4a4b-8f4e-8177c9ea20b7-kube-api-access-lkx5p\") pod \"limitador-operator-controller-manager-859d7b78bd-jrr58\" (UID: \"e7547401-3b87-4a4b-8f4e-8177c9ea20b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:13.835018 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.834951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c950ebe-1cfa-436c-88bc-bde70594ff67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qb7fs\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.835366 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.835348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c950ebe-1cfa-436c-88bc-bde70594ff67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qb7fs\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.852029 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.851975    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkx5p\" (UniqueName: \"kubernetes.io/projected/e7547401-3b87-4a4b-8f4e-8177c9ea20b7-kube-api-access-lkx5p\") pod \"limitador-operator-controller-manager-859d7b78bd-jrr58\" (UID: \"e7547401-3b87-4a4b-8f4e-8177c9ea20b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:13.855218 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.855186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72qd9\" (UniqueName: \"kubernetes.io/projected/2c950ebe-1cfa-436c-88bc-bde70594ff67-kube-api-access-72qd9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qb7fs\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:13.882412 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.882385    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.887169 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.887132    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.889542 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.889528    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:13.890059 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.890037    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:13.892616 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.892592    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:13.895294 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:13.895273    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:13.935754 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.935721    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2htg\" (UniqueName: \"kubernetes.io/projected/3533f52b-6b01-4f56-8dbb-6e743a813168-kube-api-access-c2htg\") pod \"3533f52b-6b01-4f56-8dbb-6e743a813168\" (UID: \"3533f52b-6b01-4f56-8dbb-6e743a813168\") "
Jul 21 02:06:13.935902 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.935775    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t6cx\" (UniqueName: \"kubernetes.io/projected/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-kube-api-access-8t6cx\") pod \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") "
Jul 21 02:06:13.935973 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.935897    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-extensions-socket-volume\") pod \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\" (UID: \"f1dd071e-e3f2-4093-98a2-a1e3b49b538d\") "
Jul 21 02:06:13.936472 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.936446    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f1dd071e-e3f2-4093-98a2-a1e3b49b538d" (UID: "f1dd071e-e3f2-4093-98a2-a1e3b49b538d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:13.937837 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.937818    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3533f52b-6b01-4f56-8dbb-6e743a813168-kube-api-access-c2htg" (OuterVolumeSpecName: "kube-api-access-c2htg") pod "3533f52b-6b01-4f56-8dbb-6e743a813168" (UID: "3533f52b-6b01-4f56-8dbb-6e743a813168"). InnerVolumeSpecName "kube-api-access-c2htg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:13.937891 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:13.937840    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-kube-api-access-8t6cx" (OuterVolumeSpecName: "kube-api-access-8t6cx") pod "f1dd071e-e3f2-4093-98a2-a1e3b49b538d" (UID: "f1dd071e-e3f2-4093-98a2-a1e3b49b538d"). InnerVolumeSpecName "kube-api-access-8t6cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:14.036753 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.036718    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2htg\" (UniqueName: \"kubernetes.io/projected/3533f52b-6b01-4f56-8dbb-6e743a813168-kube-api-access-c2htg\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:14.036753 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.036747    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t6cx\" (UniqueName: \"kubernetes.io/projected/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-kube-api-access-8t6cx\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:14.036753 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.036759    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1dd071e-e3f2-4093-98a2-a1e3b49b538d-extensions-socket-volume\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:14.055695 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.055661    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:14.061700 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.061663    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:14.102247 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.102192    2574 generic.go:356] "Generic (PLEG): container finished" podID="3533f52b-6b01-4f56-8dbb-6e743a813168" containerID="339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e" exitCode=0
Jul 21 02:06:14.102579 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.102435    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:14.102579 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.102464    2574 scope.go:117] "RemoveContainer" containerID="339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e"
Jul 21 02:06:14.104862 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.104837    2574 generic.go:356] "Generic (PLEG): container finished" podID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" containerID="974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab" exitCode=0
Jul 21 02:06:14.104969 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.104887    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:14.107136 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.106879    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:14.109430 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.109221    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:14.111663 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.111626    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:14.114247 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.114192    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:14.116448 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.115568    2574 scope.go:117] "RemoveContainer" containerID="339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e"
Jul 21 02:06:14.116448 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.115914    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e\": container with ID starting with 339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e not found: ID does not exist" containerID="339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e"
Jul 21 02:06:14.116448 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.115951    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e"} err="failed to get container status \"339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e\": rpc error: code = NotFound desc = could not find container \"339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e\": container with ID starting with 339502c7ed1f7d5639537d8d777c4d907c309521fbb7848a8465c97915d5267e not found: ID does not exist"
Jul 21 02:06:14.116448 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.115975    2574 scope.go:117] "RemoveContainer" containerID="974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab"
Jul 21 02:06:14.123521 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.123487    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:14.126881 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.126085    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:14.134814 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.134767    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7fr7j\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7fr7j"
Jul 21 02:06:14.136951 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.136795    2574 scope.go:117] "RemoveContainer" containerID="974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab"
Jul 21 02:06:14.137506 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.137475    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab\": container with ID starting with 974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab not found: ID does not exist" containerID="974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab"
Jul 21 02:06:14.137620 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.137520    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab"} err="failed to get container status \"974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab\": rpc error: code = NotFound desc = could not find container \"974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab\": container with ID starting with 974c881b142e5e5fef7e772db55e020419c1ea60417a31e1920aec81c029acab not found: ID does not exist"
Jul 21 02:06:14.137948 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:14.137915    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hsq7g\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hsq7g"
Jul 21 02:06:14.234295 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.234259    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"]
Jul 21 02:06:14.236170 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:06:14.236134    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c950ebe_1cfa_436c_88bc_bde70594ff67.slice/crio-9537c398a38c6f403d951b6c0f9b8f660759656bdd89b001bdce15ba19831b6d WatchSource:0}: Error finding container 9537c398a38c6f403d951b6c0f9b8f660759656bdd89b001bdce15ba19831b6d: Status 404 returned error can't find the container with id 9537c398a38c6f403d951b6c0f9b8f660759656bdd89b001bdce15ba19831b6d
Jul 21 02:06:14.244046 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:14.244026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"]
Jul 21 02:06:14.245340 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:06:14.245317    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7547401_3b87_4a4b_8f4e_8177c9ea20b7.slice/crio-a451206a63d1ad28a05d7a665e8fac48d2e5665afb20ada37bd68742f6d714fa WatchSource:0}: Error finding container a451206a63d1ad28a05d7a665e8fac48d2e5665afb20ada37bd68742f6d714fa: Status 404 returned error can't find the container with id a451206a63d1ad28a05d7a665e8fac48d2e5665afb20ada37bd68742f6d714fa
Jul 21 02:06:15.022092 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.022061    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3533f52b-6b01-4f56-8dbb-6e743a813168" path="/var/lib/kubelet/pods/3533f52b-6b01-4f56-8dbb-6e743a813168/volumes"
Jul 21 02:06:15.022477 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.022443    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1dd071e-e3f2-4093-98a2-a1e3b49b538d" path="/var/lib/kubelet/pods/f1dd071e-e3f2-4093-98a2-a1e3b49b538d/volumes"
Jul 21 02:06:15.045908 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.045881    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qhjwk"
Jul 21 02:06:15.113799 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.113766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58" event={"ID":"e7547401-3b87-4a4b-8f4e-8177c9ea20b7","Type":"ContainerStarted","Data":"eae971ae90fee364d1b97bd6390a246513c37360511d9c234d221f9ab1a4dfe2"}
Jul 21 02:06:15.113953 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.113826    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58" event={"ID":"e7547401-3b87-4a4b-8f4e-8177c9ea20b7","Type":"ContainerStarted","Data":"a451206a63d1ad28a05d7a665e8fac48d2e5665afb20ada37bd68742f6d714fa"}
Jul 21 02:06:15.114034 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.113955    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:15.115762 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.115730    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs" event={"ID":"2c950ebe-1cfa-436c-88bc-bde70594ff67","Type":"ContainerStarted","Data":"3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49"}
Jul 21 02:06:15.115893 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.115774    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs" event={"ID":"2c950ebe-1cfa-436c-88bc-bde70594ff67","Type":"ContainerStarted","Data":"9537c398a38c6f403d951b6c0f9b8f660759656bdd89b001bdce15ba19831b6d"}
Jul 21 02:06:15.115893 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.115824    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:15.137850 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.137800    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58" podStartSLOduration=2.137782945 podStartE2EDuration="2.137782945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:15.135594968 +0000 UTC m=+742.877401309" watchObservedRunningTime="2026-07-21 02:06:15.137782945 +0000 UTC m=+742.879589286"
Jul 21 02:06:15.156244 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:15.156195    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs" podStartSLOduration=2.156179499 podStartE2EDuration="2.156179499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:15.154618489 +0000 UTC m=+742.896424829" watchObservedRunningTime="2026-07-21 02:06:15.156179499 +0000 UTC m=+742.897985839"
Jul 21 02:06:26.124671 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:26.124631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jrr58"
Jul 21 02:06:26.125186 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:26.124713    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:31.311375 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:31.311341    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"]
Jul 21 02:06:31.311805 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:31.311560    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs" podUID="2c950ebe-1cfa-436c-88bc-bde70594ff67" containerName="manager" containerID="cri-o://3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49" gracePeriod=10
Jul 21 02:06:32.165651 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.165625    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:32.215826 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.215797    2574 generic.go:356] "Generic (PLEG): container finished" podID="2c950ebe-1cfa-436c-88bc-bde70594ff67" containerID="3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49" exitCode=0
Jul 21 02:06:32.215985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.215839    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"
Jul 21 02:06:32.215985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.215840    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs" event={"ID":"2c950ebe-1cfa-436c-88bc-bde70594ff67","Type":"ContainerDied","Data":"3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49"}
Jul 21 02:06:32.215985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.215912    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs" event={"ID":"2c950ebe-1cfa-436c-88bc-bde70594ff67","Type":"ContainerDied","Data":"9537c398a38c6f403d951b6c0f9b8f660759656bdd89b001bdce15ba19831b6d"}
Jul 21 02:06:32.215985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.215947    2574 scope.go:117] "RemoveContainer" containerID="3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49"
Jul 21 02:06:32.224784 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.224766    2574 scope.go:117] "RemoveContainer" containerID="3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49"
Jul 21 02:06:32.225069 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:32.225051    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49\": container with ID starting with 3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49 not found: ID does not exist" containerID="3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49"
Jul 21 02:06:32.225120 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.225079    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49"} err="failed to get container status \"3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49\": rpc error: code = NotFound desc = could not find container \"3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49\": container with ID starting with 3ab57054a77183294ecb5be1144c0b9a49a75fc371c3c2a209d7eebb78411d49 not found: ID does not exist"
Jul 21 02:06:32.298903 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.298812    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c950ebe-1cfa-436c-88bc-bde70594ff67-extensions-socket-volume\") pod \"2c950ebe-1cfa-436c-88bc-bde70594ff67\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") "
Jul 21 02:06:32.298903 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.298892    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72qd9\" (UniqueName: \"kubernetes.io/projected/2c950ebe-1cfa-436c-88bc-bde70594ff67-kube-api-access-72qd9\") pod \"2c950ebe-1cfa-436c-88bc-bde70594ff67\" (UID: \"2c950ebe-1cfa-436c-88bc-bde70594ff67\") "
Jul 21 02:06:32.299293 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.299269    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c950ebe-1cfa-436c-88bc-bde70594ff67-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c950ebe-1cfa-436c-88bc-bde70594ff67" (UID: "2c950ebe-1cfa-436c-88bc-bde70594ff67"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:32.300930 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.300909    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c950ebe-1cfa-436c-88bc-bde70594ff67-kube-api-access-72qd9" (OuterVolumeSpecName: "kube-api-access-72qd9") pod "2c950ebe-1cfa-436c-88bc-bde70594ff67" (UID: "2c950ebe-1cfa-436c-88bc-bde70594ff67"). InnerVolumeSpecName "kube-api-access-72qd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:32.400124 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.400086    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72qd9\" (UniqueName: \"kubernetes.io/projected/2c950ebe-1cfa-436c-88bc-bde70594ff67-kube-api-access-72qd9\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:32.400124 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.400117    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c950ebe-1cfa-436c-88bc-bde70594ff67-extensions-socket-volume\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:32.542642 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.542608    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"]
Jul 21 02:06:32.553470 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:32.553409    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qb7fs"]
Jul 21 02:06:33.022126 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:33.022091    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c950ebe-1cfa-436c-88bc-bde70594ff67" path="/var/lib/kubelet/pods/2c950ebe-1cfa-436c-88bc-bde70594ff67/volumes"
Jul 21 02:06:49.849089 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.849047    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:06:49.849729 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.849628    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c950ebe-1cfa-436c-88bc-bde70594ff67" containerName="manager"
Jul 21 02:06:49.849729 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.849650    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c950ebe-1cfa-436c-88bc-bde70594ff67" containerName="manager"
Jul 21 02:06:49.849856 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.849761    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c950ebe-1cfa-436c-88bc-bde70594ff67" containerName="manager"
Jul 21 02:06:49.852949 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.852926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:49.856408 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.856384    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 02:06:49.856535 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.856454    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tkr4w\""
Jul 21 02:06:49.866723 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.866698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:06:49.948708 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.948676    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:06:49.955806 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.955775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqkb\" (UniqueName: \"kubernetes.io/projected/fd1319e7-c851-42f0-adc8-36f4b65c07f2-kube-api-access-5dqkb\") pod \"limitador-limitador-64c94fd64f-wv7bq\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:49.955972 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:49.955847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd1319e7-c851-42f0-adc8-36f4b65c07f2-config-file\") pod \"limitador-limitador-64c94fd64f-wv7bq\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:50.057032 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.056991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqkb\" (UniqueName: \"kubernetes.io/projected/fd1319e7-c851-42f0-adc8-36f4b65c07f2-kube-api-access-5dqkb\") pod \"limitador-limitador-64c94fd64f-wv7bq\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:50.057227 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.057052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd1319e7-c851-42f0-adc8-36f4b65c07f2-config-file\") pod \"limitador-limitador-64c94fd64f-wv7bq\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:50.057634 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.057613    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd1319e7-c851-42f0-adc8-36f4b65c07f2-config-file\") pod \"limitador-limitador-64c94fd64f-wv7bq\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:50.078908 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.078869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqkb\" (UniqueName: \"kubernetes.io/projected/fd1319e7-c851-42f0-adc8-36f4b65c07f2-kube-api-access-5dqkb\") pod \"limitador-limitador-64c94fd64f-wv7bq\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:50.163492 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.163392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:50.309544 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.309515    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:06:50.312213 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:06:50.312181    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1319e7_c851_42f0_adc8_36f4b65c07f2.slice/crio-ef5d639d26141d060a58bc0679203d009dbca5e3346aeb92d7c1f77df5739c7d WatchSource:0}: Error finding container ef5d639d26141d060a58bc0679203d009dbca5e3346aeb92d7c1f77df5739c7d: Status 404 returned error can't find the container with id ef5d639d26141d060a58bc0679203d009dbca5e3346aeb92d7c1f77df5739c7d
Jul 21 02:06:50.696006 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.695970    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6sjkl"]
Jul 21 02:06:50.700661 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.700635    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:50.703554 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.703523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l49lr\""
Jul 21 02:06:50.706007 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.705983    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sjkl"]
Jul 21 02:06:50.763088 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.763050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56v92\" (UniqueName: \"kubernetes.io/projected/c5b7285f-7b6d-46e4-8385-20f2d24476f2-kube-api-access-56v92\") pod \"authorino-58cd955675-6sjkl\" (UID: \"c5b7285f-7b6d-46e4-8385-20f2d24476f2\") " pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:50.803359 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.803321    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv2ls"]
Jul 21 02:06:50.806705 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.806688    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:06:50.812152 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.812125    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv2ls"]
Jul 21 02:06:50.864007 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.863974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56v92\" (UniqueName: \"kubernetes.io/projected/c5b7285f-7b6d-46e4-8385-20f2d24476f2-kube-api-access-56v92\") pod \"authorino-58cd955675-6sjkl\" (UID: \"c5b7285f-7b6d-46e4-8385-20f2d24476f2\") " pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:50.864450 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.864054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2bj\" (UniqueName: \"kubernetes.io/projected/dd7c3b5f-5d50-44ec-9852-46745c3d736b-kube-api-access-zg2bj\") pod \"authorino-75d556bd77-zv2ls\" (UID: \"dd7c3b5f-5d50-44ec-9852-46745c3d736b\") " pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:06:50.875495 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.875470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56v92\" (UniqueName: \"kubernetes.io/projected/c5b7285f-7b6d-46e4-8385-20f2d24476f2-kube-api-access-56v92\") pod \"authorino-58cd955675-6sjkl\" (UID: \"c5b7285f-7b6d-46e4-8385-20f2d24476f2\") " pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:50.965162 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.965124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2bj\" (UniqueName: \"kubernetes.io/projected/dd7c3b5f-5d50-44ec-9852-46745c3d736b-kube-api-access-zg2bj\") pod \"authorino-75d556bd77-zv2ls\" (UID: \"dd7c3b5f-5d50-44ec-9852-46745c3d736b\") " pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:06:50.975180 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:50.975155    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2bj\" (UniqueName: \"kubernetes.io/projected/dd7c3b5f-5d50-44ec-9852-46745c3d736b-kube-api-access-zg2bj\") pod \"authorino-75d556bd77-zv2ls\" (UID: \"dd7c3b5f-5d50-44ec-9852-46745c3d736b\") " pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:06:51.010930 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:51.010891    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:51.117345 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:51.116913    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:06:51.238926 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:51.235011    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sjkl"]
Jul 21 02:06:51.248911 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:06:51.248874    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5b7285f_7b6d_46e4_8385_20f2d24476f2.slice/crio-cccd8c31e5800161b5b2886cc2875962034f0b2e884bfccd065688e62174bb9c WatchSource:0}: Error finding container cccd8c31e5800161b5b2886cc2875962034f0b2e884bfccd065688e62174bb9c: Status 404 returned error can't find the container with id cccd8c31e5800161b5b2886cc2875962034f0b2e884bfccd065688e62174bb9c
Jul 21 02:06:51.337291 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:51.337160    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq" event={"ID":"fd1319e7-c851-42f0-adc8-36f4b65c07f2","Type":"ContainerStarted","Data":"ef5d639d26141d060a58bc0679203d009dbca5e3346aeb92d7c1f77df5739c7d"}
Jul 21 02:06:51.339058 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:51.339001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sjkl" event={"ID":"c5b7285f-7b6d-46e4-8385-20f2d24476f2","Type":"ContainerStarted","Data":"cccd8c31e5800161b5b2886cc2875962034f0b2e884bfccd065688e62174bb9c"}
Jul 21 02:06:51.341834 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:51.341810    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv2ls"]
Jul 21 02:06:51.343645 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:06:51.343616    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd7c3b5f_5d50_44ec_9852_46745c3d736b.slice/crio-d6596f44b3296908cb74d598f9158d755a0bac9b8c82446a2399123b3b6c30a9 WatchSource:0}: Error finding container d6596f44b3296908cb74d598f9158d755a0bac9b8c82446a2399123b3b6c30a9: Status 404 returned error can't find the container with id d6596f44b3296908cb74d598f9158d755a0bac9b8c82446a2399123b3b6c30a9
Jul 21 02:06:52.350421 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:52.350352    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv2ls" event={"ID":"dd7c3b5f-5d50-44ec-9852-46745c3d736b","Type":"ContainerStarted","Data":"d6596f44b3296908cb74d598f9158d755a0bac9b8c82446a2399123b3b6c30a9"}
Jul 21 02:06:55.374173 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.374070    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv2ls" event={"ID":"dd7c3b5f-5d50-44ec-9852-46745c3d736b","Type":"ContainerStarted","Data":"d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b"}
Jul 21 02:06:55.375814 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.375785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sjkl" event={"ID":"c5b7285f-7b6d-46e4-8385-20f2d24476f2","Type":"ContainerStarted","Data":"683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b"}
Jul 21 02:06:55.377481 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.377452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq" event={"ID":"fd1319e7-c851-42f0-adc8-36f4b65c07f2","Type":"ContainerStarted","Data":"07d702922a127a6c3df535abb8ad673ca9321d3323c8ba6f5fb0d454cb4f7b68"}
Jul 21 02:06:55.377585 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.377506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:06:55.391820 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.391770    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zv2ls" podStartSLOduration=1.541709703 podStartE2EDuration="5.391755066s" totalImagesPullingTime="3.850045363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:55.389502876 +0000 UTC m=+783.131309228" watchObservedRunningTime="2026-07-21 02:06:55.391755066 +0000 UTC m=+783.133561407"
Jul 21 02:06:55.403788 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.403728    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6sjkl" podStartSLOduration=1.465528436 podStartE2EDuration="5.403708781s" totalImagesPullingTime="3.938180345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:55.403291239 +0000 UTC m=+783.145097582" watchObservedRunningTime="2026-07-21 02:06:55.403708781 +0000 UTC m=+783.145515125"
Jul 21 02:06:55.421269 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.421203    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq" podStartSLOduration=1.616483433 podStartE2EDuration="6.421181927s" totalImagesPullingTime="4.804698494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:06:55.420483513 +0000 UTC m=+783.162289856" watchObservedRunningTime="2026-07-21 02:06:55.421181927 +0000 UTC m=+783.162988270"
Jul 21 02:06:55.426152 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:55.426120    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sjkl"]
Jul 21 02:06:57.389034 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:57.388997    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6sjkl" podUID="c5b7285f-7b6d-46e4-8385-20f2d24476f2" containerName="authorino" containerID="cri-o://683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b" gracePeriod=30
Jul 21 02:06:57.648711 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:57.648649    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:57.741740 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:57.741698    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56v92\" (UniqueName: \"kubernetes.io/projected/c5b7285f-7b6d-46e4-8385-20f2d24476f2-kube-api-access-56v92\") pod \"c5b7285f-7b6d-46e4-8385-20f2d24476f2\" (UID: \"c5b7285f-7b6d-46e4-8385-20f2d24476f2\") "
Jul 21 02:06:57.743769 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:57.743740    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b7285f-7b6d-46e4-8385-20f2d24476f2-kube-api-access-56v92" (OuterVolumeSpecName: "kube-api-access-56v92") pod "c5b7285f-7b6d-46e4-8385-20f2d24476f2" (UID: "c5b7285f-7b6d-46e4-8385-20f2d24476f2"). InnerVolumeSpecName "kube-api-access-56v92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:57.842720 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:57.842686    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56v92\" (UniqueName: \"kubernetes.io/projected/c5b7285f-7b6d-46e4-8385-20f2d24476f2-kube-api-access-56v92\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:06:58.395938 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.395907    2574 generic.go:356] "Generic (PLEG): container finished" podID="c5b7285f-7b6d-46e4-8385-20f2d24476f2" containerID="683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b" exitCode=0
Jul 21 02:06:58.396388 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.395945    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sjkl"
Jul 21 02:06:58.396388 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.395994    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sjkl" event={"ID":"c5b7285f-7b6d-46e4-8385-20f2d24476f2","Type":"ContainerDied","Data":"683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b"}
Jul 21 02:06:58.396388 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.396036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sjkl" event={"ID":"c5b7285f-7b6d-46e4-8385-20f2d24476f2","Type":"ContainerDied","Data":"cccd8c31e5800161b5b2886cc2875962034f0b2e884bfccd065688e62174bb9c"}
Jul 21 02:06:58.396388 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.396053    2574 scope.go:117] "RemoveContainer" containerID="683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b"
Jul 21 02:06:58.405031 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.405013    2574 scope.go:117] "RemoveContainer" containerID="683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b"
Jul 21 02:06:58.405330 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:06:58.405312    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b\": container with ID starting with 683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b not found: ID does not exist" containerID="683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b"
Jul 21 02:06:58.405401 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.405338    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b"} err="failed to get container status \"683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b\": rpc error: code = NotFound desc = could not find container \"683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b\": container with ID starting with 683942ea595e245892cf4027a65fe485eff771d889366485cc1bb2b17bc36d2b not found: ID does not exist"
Jul 21 02:06:58.420653 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.420617    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sjkl"]
Jul 21 02:06:58.422680 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:58.422658    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sjkl"]
Jul 21 02:06:59.021715 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:06:59.021672    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b7285f-7b6d-46e4-8385-20f2d24476f2" path="/var/lib/kubelet/pods/c5b7285f-7b6d-46e4-8385-20f2d24476f2/volumes"
Jul 21 02:07:06.384681 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:06.384652    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:07:21.975838 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:21.975798    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:07:21.976461 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:21.976016    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq" podUID="fd1319e7-c851-42f0-adc8-36f4b65c07f2" containerName="limitador" containerID="cri-o://07d702922a127a6c3df535abb8ad673ca9321d3323c8ba6f5fb0d454cb4f7b68" gracePeriod=30
Jul 21 02:07:22.529440 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:22.529401    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1319e7-c851-42f0-adc8-36f4b65c07f2" containerID="07d702922a127a6c3df535abb8ad673ca9321d3323c8ba6f5fb0d454cb4f7b68" exitCode=0
Jul 21 02:07:22.529607 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:22.529473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq" event={"ID":"fd1319e7-c851-42f0-adc8-36f4b65c07f2","Type":"ContainerDied","Data":"07d702922a127a6c3df535abb8ad673ca9321d3323c8ba6f5fb0d454cb4f7b68"}
Jul 21 02:07:22.923735 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:22.923707    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:07:23.062469 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.062394    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dqkb\" (UniqueName: \"kubernetes.io/projected/fd1319e7-c851-42f0-adc8-36f4b65c07f2-kube-api-access-5dqkb\") pod \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") "
Jul 21 02:07:23.062469 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.062459    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd1319e7-c851-42f0-adc8-36f4b65c07f2-config-file\") pod \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\" (UID: \"fd1319e7-c851-42f0-adc8-36f4b65c07f2\") "
Jul 21 02:07:23.062856 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.062783    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd1319e7-c851-42f0-adc8-36f4b65c07f2-config-file" (OuterVolumeSpecName: "config-file") pod "fd1319e7-c851-42f0-adc8-36f4b65c07f2" (UID: "fd1319e7-c851-42f0-adc8-36f4b65c07f2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:07:23.064515 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.064490    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1319e7-c851-42f0-adc8-36f4b65c07f2-kube-api-access-5dqkb" (OuterVolumeSpecName: "kube-api-access-5dqkb") pod "fd1319e7-c851-42f0-adc8-36f4b65c07f2" (UID: "fd1319e7-c851-42f0-adc8-36f4b65c07f2"). InnerVolumeSpecName "kube-api-access-5dqkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:07:23.163008 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.162972    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd1319e7-c851-42f0-adc8-36f4b65c07f2-config-file\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:07:23.163008 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.163005    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dqkb\" (UniqueName: \"kubernetes.io/projected/fd1319e7-c851-42f0-adc8-36f4b65c07f2-kube-api-access-5dqkb\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:07:23.536542 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.536507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq" event={"ID":"fd1319e7-c851-42f0-adc8-36f4b65c07f2","Type":"ContainerDied","Data":"ef5d639d26141d060a58bc0679203d009dbca5e3346aeb92d7c1f77df5739c7d"}
Jul 21 02:07:23.536542 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.536530    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"
Jul 21 02:07:23.536857 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.536568    2574 scope.go:117] "RemoveContainer" containerID="07d702922a127a6c3df535abb8ad673ca9321d3323c8ba6f5fb0d454cb4f7b68"
Jul 21 02:07:23.564218 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.564190    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:07:23.568050 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:23.568024    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wv7bq"]
Jul 21 02:07:25.021819 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:25.021783    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1319e7-c851-42f0-adc8-36f4b65c07f2" path="/var/lib/kubelet/pods/fd1319e7-c851-42f0-adc8-36f4b65c07f2/volumes"
Jul 21 02:07:26.856002 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.855963    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"]
Jul 21 02:07:26.856584 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.856567    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b7285f-7b6d-46e4-8385-20f2d24476f2" containerName="authorino"
Jul 21 02:07:26.856630 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.856587    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b7285f-7b6d-46e4-8385-20f2d24476f2" containerName="authorino"
Jul 21 02:07:26.856630 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.856599    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1319e7-c851-42f0-adc8-36f4b65c07f2" containerName="limitador"
Jul 21 02:07:26.856630 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.856608    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1319e7-c851-42f0-adc8-36f4b65c07f2" containerName="limitador"
Jul 21 02:07:26.856726 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.856710    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1319e7-c851-42f0-adc8-36f4b65c07f2" containerName="limitador"
Jul 21 02:07:26.856758 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.856727    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5b7285f-7b6d-46e4-8385-20f2d24476f2" containerName="authorino"
Jul 21 02:07:26.864521 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.864498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:26.867582 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.867559    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-n2czl\""
Jul 21 02:07:26.867822 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.867625    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 02:07:26.867930 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.867639    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 02:07:26.868416 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.868397    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"]
Jul 21 02:07:26.868578 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.868563    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 02:07:26.991432 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.991401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w97cc\" (UniqueName: \"kubernetes.io/projected/172ccbc0-858b-427a-b099-cbd52fda7b6a-kube-api-access-w97cc\") pod \"postgres-69fb4594cf-sdhvt\" (UID: \"172ccbc0-858b-427a-b099-cbd52fda7b6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:26.991609 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:26.991463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/172ccbc0-858b-427a-b099-cbd52fda7b6a-data\") pod \"postgres-69fb4594cf-sdhvt\" (UID: \"172ccbc0-858b-427a-b099-cbd52fda7b6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:27.092778 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.092735    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w97cc\" (UniqueName: \"kubernetes.io/projected/172ccbc0-858b-427a-b099-cbd52fda7b6a-kube-api-access-w97cc\") pod \"postgres-69fb4594cf-sdhvt\" (UID: \"172ccbc0-858b-427a-b099-cbd52fda7b6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:27.092983 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.092805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/172ccbc0-858b-427a-b099-cbd52fda7b6a-data\") pod \"postgres-69fb4594cf-sdhvt\" (UID: \"172ccbc0-858b-427a-b099-cbd52fda7b6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:27.093224 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.093202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/172ccbc0-858b-427a-b099-cbd52fda7b6a-data\") pod \"postgres-69fb4594cf-sdhvt\" (UID: \"172ccbc0-858b-427a-b099-cbd52fda7b6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:27.106440 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.106371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w97cc\" (UniqueName: \"kubernetes.io/projected/172ccbc0-858b-427a-b099-cbd52fda7b6a-kube-api-access-w97cc\") pod \"postgres-69fb4594cf-sdhvt\" (UID: \"172ccbc0-858b-427a-b099-cbd52fda7b6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:27.176022 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.175984    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:27.311259 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.311214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"]
Jul 21 02:07:27.314084 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:07:27.314057    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172ccbc0_858b_427a_b099_cbd52fda7b6a.slice/crio-302fe7569b21214413a2ea373bb98a8b68262cf68980a874cd0554277074947b WatchSource:0}: Error finding container 302fe7569b21214413a2ea373bb98a8b68262cf68980a874cd0554277074947b: Status 404 returned error can't find the container with id 302fe7569b21214413a2ea373bb98a8b68262cf68980a874cd0554277074947b
Jul 21 02:07:27.558830 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:27.558793    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt" event={"ID":"172ccbc0-858b-427a-b099-cbd52fda7b6a","Type":"ContainerStarted","Data":"302fe7569b21214413a2ea373bb98a8b68262cf68980a874cd0554277074947b"}
Jul 21 02:07:32.593285 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:32.593243    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt" event={"ID":"172ccbc0-858b-427a-b099-cbd52fda7b6a","Type":"ContainerStarted","Data":"dc251689361e6282dc36b8b51c91c81aa64e7e8ca46d8044e5636c9af83c6773"}
Jul 21 02:07:32.593765 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:32.593357    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:32.610615 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:32.610567    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt" podStartSLOduration=2.109603584 podStartE2EDuration="6.610552363s" totalImagesPullingTime="4.500948779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:32.609084305 +0000 UTC m=+820.350890647" watchObservedRunningTime="2026-07-21 02:07:32.610552363 +0000 UTC m=+820.352358703"
Jul 21 02:07:38.628279 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:38.628251    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sdhvt"
Jul 21 02:07:39.159407 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.159379    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h9f22"]
Jul 21 02:07:39.163173 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.163156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:39.169871 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.169843    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h9f22"]
Jul 21 02:07:39.202146 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.202107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swgsq\" (UniqueName: \"kubernetes.io/projected/e747dd2c-0952-4c4e-949a-5b91948ca0e7-kube-api-access-swgsq\") pod \"authorino-5d4b67c446-h9f22\" (UID: \"e747dd2c-0952-4c4e-949a-5b91948ca0e7\") " pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:39.303625 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.303584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swgsq\" (UniqueName: \"kubernetes.io/projected/e747dd2c-0952-4c4e-949a-5b91948ca0e7-kube-api-access-swgsq\") pod \"authorino-5d4b67c446-h9f22\" (UID: \"e747dd2c-0952-4c4e-949a-5b91948ca0e7\") " pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:39.311942 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.311913    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swgsq\" (UniqueName: \"kubernetes.io/projected/e747dd2c-0952-4c4e-949a-5b91948ca0e7-kube-api-access-swgsq\") pod \"authorino-5d4b67c446-h9f22\" (UID: \"e747dd2c-0952-4c4e-949a-5b91948ca0e7\") " pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:39.388991 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.388946    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h9f22"]
Jul 21 02:07:39.389245 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.389221    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:39.414956 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.414878    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68989478f4-mdsmn"]
Jul 21 02:07:39.419476 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.419453    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:39.425366 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.425339    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68989478f4-mdsmn"]
Jul 21 02:07:39.505988 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.505950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59k68\" (UniqueName: \"kubernetes.io/projected/7523fe02-f063-4f5c-85c5-54bdf2e2c40b-kube-api-access-59k68\") pod \"authorino-68989478f4-mdsmn\" (UID: \"7523fe02-f063-4f5c-85c5-54bdf2e2c40b\") " pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:39.528359 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.528327    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h9f22"]
Jul 21 02:07:39.530017 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:07:39.529990    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode747dd2c_0952_4c4e_949a_5b91948ca0e7.slice/crio-8c6d88edf38da2274d35a64a7de432dded65f77bb5a7ef8390061f3d7d57fcf3 WatchSource:0}: Error finding container 8c6d88edf38da2274d35a64a7de432dded65f77bb5a7ef8390061f3d7d57fcf3: Status 404 returned error can't find the container with id 8c6d88edf38da2274d35a64a7de432dded65f77bb5a7ef8390061f3d7d57fcf3
Jul 21 02:07:39.541666 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.541645    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68989478f4-mdsmn"]
Jul 21 02:07:39.541920 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:07:39.541891    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-59k68], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-68989478f4-mdsmn" podUID="7523fe02-f063-4f5c-85c5-54bdf2e2c40b"
Jul 21 02:07:39.568327 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.568298    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d6c85dd7d-qf9cb"]
Jul 21 02:07:39.572032 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.572014    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.574429 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.574411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 02:07:39.579283 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.579261    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d6c85dd7d-qf9cb"]
Jul 21 02:07:39.610675 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.606915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24930647-2c41-4b89-b5db-4e05422e283d-tls-cert\") pod \"authorino-6d6c85dd7d-qf9cb\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") " pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.610675 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.606987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59k68\" (UniqueName: \"kubernetes.io/projected/7523fe02-f063-4f5c-85c5-54bdf2e2c40b-kube-api-access-59k68\") pod \"authorino-68989478f4-mdsmn\" (UID: \"7523fe02-f063-4f5c-85c5-54bdf2e2c40b\") " pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:39.610675 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.607097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz8fb\" (UniqueName: \"kubernetes.io/projected/24930647-2c41-4b89-b5db-4e05422e283d-kube-api-access-jz8fb\") pod \"authorino-6d6c85dd7d-qf9cb\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") " pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.616076 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.616035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59k68\" (UniqueName: \"kubernetes.io/projected/7523fe02-f063-4f5c-85c5-54bdf2e2c40b-kube-api-access-59k68\") pod \"authorino-68989478f4-mdsmn\" (UID: \"7523fe02-f063-4f5c-85c5-54bdf2e2c40b\") " pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:39.631694 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.631664    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h9f22" event={"ID":"e747dd2c-0952-4c4e-949a-5b91948ca0e7","Type":"ContainerStarted","Data":"8c6d88edf38da2274d35a64a7de432dded65f77bb5a7ef8390061f3d7d57fcf3"}
Jul 21 02:07:39.632087 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.631732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:39.638979 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.638958    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:39.708554 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.708471    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59k68\" (UniqueName: \"kubernetes.io/projected/7523fe02-f063-4f5c-85c5-54bdf2e2c40b-kube-api-access-59k68\") pod \"7523fe02-f063-4f5c-85c5-54bdf2e2c40b\" (UID: \"7523fe02-f063-4f5c-85c5-54bdf2e2c40b\") "
Jul 21 02:07:39.708695 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.708587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8fb\" (UniqueName: \"kubernetes.io/projected/24930647-2c41-4b89-b5db-4e05422e283d-kube-api-access-jz8fb\") pod \"authorino-6d6c85dd7d-qf9cb\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") " pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.708695 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.708647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24930647-2c41-4b89-b5db-4e05422e283d-tls-cert\") pod \"authorino-6d6c85dd7d-qf9cb\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") " pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.710599 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.710567    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7523fe02-f063-4f5c-85c5-54bdf2e2c40b-kube-api-access-59k68" (OuterVolumeSpecName: "kube-api-access-59k68") pod "7523fe02-f063-4f5c-85c5-54bdf2e2c40b" (UID: "7523fe02-f063-4f5c-85c5-54bdf2e2c40b"). InnerVolumeSpecName "kube-api-access-59k68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:07:39.710943 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.710926    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24930647-2c41-4b89-b5db-4e05422e283d-tls-cert\") pod \"authorino-6d6c85dd7d-qf9cb\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") " pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.716324 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.716302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8fb\" (UniqueName: \"kubernetes.io/projected/24930647-2c41-4b89-b5db-4e05422e283d-kube-api-access-jz8fb\") pod \"authorino-6d6c85dd7d-qf9cb\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") " pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:39.809685 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.809636    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59k68\" (UniqueName: \"kubernetes.io/projected/7523fe02-f063-4f5c-85c5-54bdf2e2c40b-kube-api-access-59k68\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:07:39.882454 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:39.882421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:07:40.013362 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.013336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d6c85dd7d-qf9cb"]
Jul 21 02:07:40.014716 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:07:40.014682    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24930647_2c41_4b89_b5db_4e05422e283d.slice/crio-2fdb395fa948e860ba96a3b3119dea3a794e37b5086bcc95efec6ea67575a513 WatchSource:0}: Error finding container 2fdb395fa948e860ba96a3b3119dea3a794e37b5086bcc95efec6ea67575a513: Status 404 returned error can't find the container with id 2fdb395fa948e860ba96a3b3119dea3a794e37b5086bcc95efec6ea67575a513
Jul 21 02:07:40.638763 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.638674    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb" event={"ID":"24930647-2c41-4b89-b5db-4e05422e283d","Type":"ContainerStarted","Data":"99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d"}
Jul 21 02:07:40.638763 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.638729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb" event={"ID":"24930647-2c41-4b89-b5db-4e05422e283d","Type":"ContainerStarted","Data":"2fdb395fa948e860ba96a3b3119dea3a794e37b5086bcc95efec6ea67575a513"}
Jul 21 02:07:40.640276 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.640249    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h9f22" event={"ID":"e747dd2c-0952-4c4e-949a-5b91948ca0e7","Type":"ContainerStarted","Data":"69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1"}
Jul 21 02:07:40.640365 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.640279    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-h9f22" podUID="e747dd2c-0952-4c4e-949a-5b91948ca0e7" containerName="authorino" containerID="cri-o://69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1" gracePeriod=30
Jul 21 02:07:40.640365 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.640303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68989478f4-mdsmn"
Jul 21 02:07:40.656691 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.656649    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb" podStartSLOduration=1.3320357170000001 podStartE2EDuration="1.656632573s" totalImagesPullingTime="324.596856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:40.655183661 +0000 UTC m=+828.396990008" watchObservedRunningTime="2026-07-21 02:07:40.656632573 +0000 UTC m=+828.398438914"
Jul 21 02:07:40.671548 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.671488    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-h9f22" podStartSLOduration=1.171574784 podStartE2EDuration="1.671468336s" totalImagesPullingTime="499.893552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:40.669445022 +0000 UTC m=+828.411251367" watchObservedRunningTime="2026-07-21 02:07:40.671468336 +0000 UTC m=+828.413274678"
Jul 21 02:07:40.685251 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.685211    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv2ls"]
Jul 21 02:07:40.685681 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.685413    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zv2ls" podUID="dd7c3b5f-5d50-44ec-9852-46745c3d736b" containerName="authorino" containerID="cri-o://d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b" gracePeriod=30
Jul 21 02:07:40.700111 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.700082    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68989478f4-mdsmn"]
Jul 21 02:07:40.709657 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.709627    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68989478f4-mdsmn"]
Jul 21 02:07:40.943047 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.943017    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:40.952909 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:40.952891    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:07:41.020390 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.020362    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg2bj\" (UniqueName: \"kubernetes.io/projected/dd7c3b5f-5d50-44ec-9852-46745c3d736b-kube-api-access-zg2bj\") pod \"dd7c3b5f-5d50-44ec-9852-46745c3d736b\" (UID: \"dd7c3b5f-5d50-44ec-9852-46745c3d736b\") "
Jul 21 02:07:41.020558 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.020446    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swgsq\" (UniqueName: \"kubernetes.io/projected/e747dd2c-0952-4c4e-949a-5b91948ca0e7-kube-api-access-swgsq\") pod \"e747dd2c-0952-4c4e-949a-5b91948ca0e7\" (UID: \"e747dd2c-0952-4c4e-949a-5b91948ca0e7\") "
Jul 21 02:07:41.022632 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.022601    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd7c3b5f-5d50-44ec-9852-46745c3d736b-kube-api-access-zg2bj" (OuterVolumeSpecName: "kube-api-access-zg2bj") pod "dd7c3b5f-5d50-44ec-9852-46745c3d736b" (UID: "dd7c3b5f-5d50-44ec-9852-46745c3d736b"). InnerVolumeSpecName "kube-api-access-zg2bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:07:41.022757 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.022611    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7523fe02-f063-4f5c-85c5-54bdf2e2c40b" path="/var/lib/kubelet/pods/7523fe02-f063-4f5c-85c5-54bdf2e2c40b/volumes"
Jul 21 02:07:41.022757 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.022653    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e747dd2c-0952-4c4e-949a-5b91948ca0e7-kube-api-access-swgsq" (OuterVolumeSpecName: "kube-api-access-swgsq") pod "e747dd2c-0952-4c4e-949a-5b91948ca0e7" (UID: "e747dd2c-0952-4c4e-949a-5b91948ca0e7"). InnerVolumeSpecName "kube-api-access-swgsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:07:41.121955 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.121917    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swgsq\" (UniqueName: \"kubernetes.io/projected/e747dd2c-0952-4c4e-949a-5b91948ca0e7-kube-api-access-swgsq\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:07:41.121955 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.121946    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg2bj\" (UniqueName: \"kubernetes.io/projected/dd7c3b5f-5d50-44ec-9852-46745c3d736b-kube-api-access-zg2bj\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:07:41.646960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.646871    2574 generic.go:356] "Generic (PLEG): container finished" podID="dd7c3b5f-5d50-44ec-9852-46745c3d736b" containerID="d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b" exitCode=0
Jul 21 02:07:41.646960 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.646913    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv2ls"
Jul 21 02:07:41.647514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.646961    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv2ls" event={"ID":"dd7c3b5f-5d50-44ec-9852-46745c3d736b","Type":"ContainerDied","Data":"d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b"}
Jul 21 02:07:41.647514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.647009    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv2ls" event={"ID":"dd7c3b5f-5d50-44ec-9852-46745c3d736b","Type":"ContainerDied","Data":"d6596f44b3296908cb74d598f9158d755a0bac9b8c82446a2399123b3b6c30a9"}
Jul 21 02:07:41.647514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.647031    2574 scope.go:117] "RemoveContainer" containerID="d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b"
Jul 21 02:07:41.648428 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.648326    2574 generic.go:356] "Generic (PLEG): container finished" podID="e747dd2c-0952-4c4e-949a-5b91948ca0e7" containerID="69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1" exitCode=0
Jul 21 02:07:41.648428 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.648366    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h9f22"
Jul 21 02:07:41.648528 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.648418    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h9f22" event={"ID":"e747dd2c-0952-4c4e-949a-5b91948ca0e7","Type":"ContainerDied","Data":"69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1"}
Jul 21 02:07:41.648528 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.648458    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h9f22" event={"ID":"e747dd2c-0952-4c4e-949a-5b91948ca0e7","Type":"ContainerDied","Data":"8c6d88edf38da2274d35a64a7de432dded65f77bb5a7ef8390061f3d7d57fcf3"}
Jul 21 02:07:41.656163 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.656145    2574 scope.go:117] "RemoveContainer" containerID="d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b"
Jul 21 02:07:41.656450 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:07:41.656429    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b\": container with ID starting with d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b not found: ID does not exist" containerID="d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b"
Jul 21 02:07:41.656552 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.656461    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b"} err="failed to get container status \"d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b\": rpc error: code = NotFound desc = could not find container \"d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b\": container with ID starting with d587c614709b8c1880171ea5c81d3d6f960c75f24a7814df81436c8d55d5243b not found: ID does not exist"
Jul 21 02:07:41.656552 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.656483    2574 scope.go:117] "RemoveContainer" containerID="69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1"
Jul 21 02:07:41.664626 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.664608    2574 scope.go:117] "RemoveContainer" containerID="69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1"
Jul 21 02:07:41.664865 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:07:41.664849    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1\": container with ID starting with 69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1 not found: ID does not exist" containerID="69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1"
Jul 21 02:07:41.664945 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.664871    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1"} err="failed to get container status \"69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1\": rpc error: code = NotFound desc = could not find container \"69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1\": container with ID starting with 69b199475c9f2ca3a2e308f0325375a0728912a81d85289bf2779fa7fa2e7fa1 not found: ID does not exist"
Jul 21 02:07:41.665382 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.665365    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h9f22"]
Jul 21 02:07:41.670167 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.670146    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h9f22"]
Jul 21 02:07:41.680543 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.680521    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv2ls"]
Jul 21 02:07:41.683962 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:41.683941    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv2ls"]
Jul 21 02:07:43.024126 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:43.024091    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd7c3b5f-5d50-44ec-9852-46745c3d736b" path="/var/lib/kubelet/pods/dd7c3b5f-5d50-44ec-9852-46745c3d736b/volumes"
Jul 21 02:07:43.024615 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:43.024597    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e747dd2c-0952-4c4e-949a-5b91948ca0e7" path="/var/lib/kubelet/pods/e747dd2c-0952-4c4e-949a-5b91948ca0e7/volumes"
Jul 21 02:07:45.319930 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.319899    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85d48d49f5-7nfw9"]
Jul 21 02:07:45.320354 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.320324    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7c3b5f-5d50-44ec-9852-46745c3d736b" containerName="authorino"
Jul 21 02:07:45.320354 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.320338    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7c3b5f-5d50-44ec-9852-46745c3d736b" containerName="authorino"
Jul 21 02:07:45.320354 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.320349    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e747dd2c-0952-4c4e-949a-5b91948ca0e7" containerName="authorino"
Jul 21 02:07:45.320354 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.320355    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e747dd2c-0952-4c4e-949a-5b91948ca0e7" containerName="authorino"
Jul 21 02:07:45.320487 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.320434    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e747dd2c-0952-4c4e-949a-5b91948ca0e7" containerName="authorino"
Jul 21 02:07:45.320487 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.320447    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd7c3b5f-5d50-44ec-9852-46745c3d736b" containerName="authorino"
Jul 21 02:07:45.325296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.325269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.328178 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.328146    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 02:07:45.328307 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.328183    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 02:07:45.329228 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.329212    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4vz2t\""
Jul 21 02:07:45.338967 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.338945    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d48d49f5-7nfw9"]
Jul 21 02:07:45.358750 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.358707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db52ad7c-7887-4e29-ae04-4c8920fc427c-webhook-cert\") pod \"maas-controller-85d48d49f5-7nfw9\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") " pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.358927 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.358806    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f9m2\" (UniqueName: \"kubernetes.io/projected/db52ad7c-7887-4e29-ae04-4c8920fc427c-kube-api-access-5f9m2\") pod \"maas-controller-85d48d49f5-7nfw9\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") " pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.460300 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.460259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db52ad7c-7887-4e29-ae04-4c8920fc427c-webhook-cert\") pod \"maas-controller-85d48d49f5-7nfw9\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") " pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.460485 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.460333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f9m2\" (UniqueName: \"kubernetes.io/projected/db52ad7c-7887-4e29-ae04-4c8920fc427c-kube-api-access-5f9m2\") pod \"maas-controller-85d48d49f5-7nfw9\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") " pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.462897 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.462870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db52ad7c-7887-4e29-ae04-4c8920fc427c-webhook-cert\") pod \"maas-controller-85d48d49f5-7nfw9\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") " pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.469412 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.469387    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f9m2\" (UniqueName: \"kubernetes.io/projected/db52ad7c-7887-4e29-ae04-4c8920fc427c-kube-api-access-5f9m2\") pod \"maas-controller-85d48d49f5-7nfw9\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") " pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.505819 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.505790    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54fc764664-fzzn2"]
Jul 21 02:07:45.509531 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.509511    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.519949 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.519918    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54fc764664-fzzn2"]
Jul 21 02:07:45.561713 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.561677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mb2g\" (UniqueName: \"kubernetes.io/projected/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-kube-api-access-4mb2g\") pod \"maas-controller-54fc764664-fzzn2\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") " pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.561853 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.561740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-webhook-cert\") pod \"maas-controller-54fc764664-fzzn2\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") " pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.636410 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.636322    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:45.662778 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.662747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mb2g\" (UniqueName: \"kubernetes.io/projected/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-kube-api-access-4mb2g\") pod \"maas-controller-54fc764664-fzzn2\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") " pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.662920 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.662799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-webhook-cert\") pod \"maas-controller-54fc764664-fzzn2\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") " pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.665299 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.665273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-webhook-cert\") pod \"maas-controller-54fc764664-fzzn2\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") " pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.672168 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.672126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mb2g\" (UniqueName: \"kubernetes.io/projected/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-kube-api-access-4mb2g\") pod \"maas-controller-54fc764664-fzzn2\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") " pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.777394 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.777364    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d48d49f5-7nfw9"]
Jul 21 02:07:45.778739 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:07:45.778705    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb52ad7c_7887_4e29_ae04_4c8920fc427c.slice/crio-8916eb328399e7e07ab89c160528e8020d7ba8a63f0a8495ff798fc84f21abda WatchSource:0}: Error finding container 8916eb328399e7e07ab89c160528e8020d7ba8a63f0a8495ff798fc84f21abda: Status 404 returned error can't find the container with id 8916eb328399e7e07ab89c160528e8020d7ba8a63f0a8495ff798fc84f21abda
Jul 21 02:07:45.821187 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.821161    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:45.958783 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:45.958751    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54fc764664-fzzn2"]
Jul 21 02:07:45.960046 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:07:45.960014    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6c8e30_9c86_4d93_a495_86db3e6f21a8.slice/crio-b5b23043b4fdf85766e313417336aa746fb0229f676f8ee42952a977fc4b89af WatchSource:0}: Error finding container b5b23043b4fdf85766e313417336aa746fb0229f676f8ee42952a977fc4b89af: Status 404 returned error can't find the container with id b5b23043b4fdf85766e313417336aa746fb0229f676f8ee42952a977fc4b89af
Jul 21 02:07:46.687683 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:46.687641    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d48d49f5-7nfw9" event={"ID":"db52ad7c-7887-4e29-ae04-4c8920fc427c","Type":"ContainerStarted","Data":"8916eb328399e7e07ab89c160528e8020d7ba8a63f0a8495ff798fc84f21abda"}
Jul 21 02:07:46.691421 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:46.691331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-fzzn2" event={"ID":"ae6c8e30-9c86-4d93-a495-86db3e6f21a8","Type":"ContainerStarted","Data":"b5b23043b4fdf85766e313417336aa746fb0229f676f8ee42952a977fc4b89af"}
Jul 21 02:07:48.706050 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:48.705945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d48d49f5-7nfw9" event={"ID":"db52ad7c-7887-4e29-ae04-4c8920fc427c","Type":"ContainerStarted","Data":"3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3"}
Jul 21 02:07:48.706050 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:48.706033    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:48.707951 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:48.707915    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-fzzn2" event={"ID":"ae6c8e30-9c86-4d93-a495-86db3e6f21a8","Type":"ContainerStarted","Data":"379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4"}
Jul 21 02:07:48.708081 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:48.708045    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:48.724495 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:48.724445    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85d48d49f5-7nfw9" podStartSLOduration=1.216816408 podStartE2EDuration="3.724429591s" totalImagesPullingTime="2.507613183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:48.722639585 +0000 UTC m=+836.464445957" watchObservedRunningTime="2026-07-21 02:07:48.724429591 +0000 UTC m=+836.466235932"
Jul 21 02:07:48.740472 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:48.740428    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54fc764664-fzzn2" podStartSLOduration=1.4033317570000001 podStartE2EDuration="3.740414532s" totalImagesPullingTime="2.337082775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:48.738685507 +0000 UTC m=+836.480491847" watchObservedRunningTime="2026-07-21 02:07:48.740414532 +0000 UTC m=+836.482220872"
Jul 21 02:07:59.716148 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:59.716114    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:07:59.716611 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:59.716201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:07:59.776919 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:59.776884    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d48d49f5-7nfw9"]
Jul 21 02:07:59.777993 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:07:59.777938    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85d48d49f5-7nfw9" podUID="db52ad7c-7887-4e29-ae04-4c8920fc427c" containerName="manager" containerID="cri-o://3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3" gracePeriod=30
Jul 21 02:08:00.033477 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.033444    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:08:00.093454 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.093419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f9m2\" (UniqueName: \"kubernetes.io/projected/db52ad7c-7887-4e29-ae04-4c8920fc427c-kube-api-access-5f9m2\") pod \"db52ad7c-7887-4e29-ae04-4c8920fc427c\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") "
Jul 21 02:08:00.093651 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.093527    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db52ad7c-7887-4e29-ae04-4c8920fc427c-webhook-cert\") pod \"db52ad7c-7887-4e29-ae04-4c8920fc427c\" (UID: \"db52ad7c-7887-4e29-ae04-4c8920fc427c\") "
Jul 21 02:08:00.095671 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.095639    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db52ad7c-7887-4e29-ae04-4c8920fc427c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "db52ad7c-7887-4e29-ae04-4c8920fc427c" (UID: "db52ad7c-7887-4e29-ae04-4c8920fc427c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:08:00.095779 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.095715    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db52ad7c-7887-4e29-ae04-4c8920fc427c-kube-api-access-5f9m2" (OuterVolumeSpecName: "kube-api-access-5f9m2") pod "db52ad7c-7887-4e29-ae04-4c8920fc427c" (UID: "db52ad7c-7887-4e29-ae04-4c8920fc427c"). InnerVolumeSpecName "kube-api-access-5f9m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:08:00.194815 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.194767    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db52ad7c-7887-4e29-ae04-4c8920fc427c-webhook-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:08:00.194815 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.194808    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f9m2\" (UniqueName: \"kubernetes.io/projected/db52ad7c-7887-4e29-ae04-4c8920fc427c-kube-api-access-5f9m2\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:08:00.784685 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.784650    2574 generic.go:356] "Generic (PLEG): container finished" podID="db52ad7c-7887-4e29-ae04-4c8920fc427c" containerID="3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3" exitCode=0
Jul 21 02:08:00.785141 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.784695    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d48d49f5-7nfw9"
Jul 21 02:08:00.785141 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.784711    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d48d49f5-7nfw9" event={"ID":"db52ad7c-7887-4e29-ae04-4c8920fc427c","Type":"ContainerDied","Data":"3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3"}
Jul 21 02:08:00.785141 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.784765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d48d49f5-7nfw9" event={"ID":"db52ad7c-7887-4e29-ae04-4c8920fc427c","Type":"ContainerDied","Data":"8916eb328399e7e07ab89c160528e8020d7ba8a63f0a8495ff798fc84f21abda"}
Jul 21 02:08:00.785141 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.784791    2574 scope.go:117] "RemoveContainer" containerID="3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3"
Jul 21 02:08:00.796660 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.796639    2574 scope.go:117] "RemoveContainer" containerID="3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3"
Jul 21 02:08:00.796938 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:08:00.796919    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3\": container with ID starting with 3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3 not found: ID does not exist" containerID="3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3"
Jul 21 02:08:00.797007 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.796944    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3"} err="failed to get container status \"3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3\": rpc error: code = NotFound desc = could not find container \"3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3\": container with ID starting with 3072700d4225b97d5f2c783b0d3b95f18be021cea2e1268c34f48cb39e66b2d3 not found: ID does not exist"
Jul 21 02:08:00.815098 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.815058    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d48d49f5-7nfw9"]
Jul 21 02:08:00.818965 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:00.818940    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85d48d49f5-7nfw9"]
Jul 21 02:08:01.022448 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:01.022410    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db52ad7c-7887-4e29-ae04-4c8920fc427c" path="/var/lib/kubelet/pods/db52ad7c-7887-4e29-ae04-4c8920fc427c/volumes"
Jul 21 02:08:22.360582 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.360544    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6556977745-qgf67"]
Jul 21 02:08:22.361036 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.360948    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db52ad7c-7887-4e29-ae04-4c8920fc427c" containerName="manager"
Jul 21 02:08:22.361036 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.360959    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="db52ad7c-7887-4e29-ae04-4c8920fc427c" containerName="manager"
Jul 21 02:08:22.361036 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.361033    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="db52ad7c-7887-4e29-ae04-4c8920fc427c" containerName="manager"
Jul 21 02:08:22.369513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.369489    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.372631 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.372604    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 02:08:22.373075 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.373051    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9269v\""
Jul 21 02:08:22.375781 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.375753    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6556977745-qgf67"]
Jul 21 02:08:22.486343 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.486312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt4xq\" (UniqueName: \"kubernetes.io/projected/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-kube-api-access-kt4xq\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.486527 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.486450    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-maas-api-tls\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.486527 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.486492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-openshift-service-ca\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.587213 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.587180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-maas-api-tls\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.587213 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.587219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-openshift-service-ca\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.587484 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.587298    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt4xq\" (UniqueName: \"kubernetes.io/projected/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-kube-api-access-kt4xq\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.587977 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.587956    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-openshift-service-ca\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.589692 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.589672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-maas-api-tls\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.595799 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.595777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt4xq\" (UniqueName: \"kubernetes.io/projected/77cc30a4-ec0e-4325-888c-d0dd4dea49f5-kube-api-access-kt4xq\") pod \"maas-api-6556977745-qgf67\" (UID: \"77cc30a4-ec0e-4325-888c-d0dd4dea49f5\") " pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.681953 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.681862    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:22.845514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.845481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6556977745-qgf67"]
Jul 21 02:08:22.847189 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:08:22.847166    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cc30a4_ec0e_4325_888c_d0dd4dea49f5.slice/crio-b2775b1cae76e015f5e0c828f34102db1b8a05161a116d19631fab66a4c5e95e WatchSource:0}: Error finding container b2775b1cae76e015f5e0c828f34102db1b8a05161a116d19631fab66a4c5e95e: Status 404 returned error can't find the container with id b2775b1cae76e015f5e0c828f34102db1b8a05161a116d19631fab66a4c5e95e
Jul 21 02:08:22.910037 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:22.910004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67" event={"ID":"77cc30a4-ec0e-4325-888c-d0dd4dea49f5","Type":"ContainerStarted","Data":"b2775b1cae76e015f5e0c828f34102db1b8a05161a116d19631fab66a4c5e95e"}
Jul 21 02:08:23.041943 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.041899    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-56kvv"]
Jul 21 02:08:23.047524 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.047499    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.050482 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.050450    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 02:08:23.050633 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.050553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jd5zq\""
Jul 21 02:08:23.057650 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.057626    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-56kvv"]
Jul 21 02:08:23.113205 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.113172    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fbd99"]
Jul 21 02:08:23.117049 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.117033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.128020 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.127927    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fbd99"]
Jul 21 02:08:23.192875 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.192824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9ee006-33c0-463b-8d7b-1fd4cd83cde6-plugins-config-volume\") pod \"payload-processing-5bf47cd988-56kvv\" (UID: \"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6\") " pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.193071 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.192907    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8svnf\" (UniqueName: \"kubernetes.io/projected/2f9ee006-33c0-463b-8d7b-1fd4cd83cde6-kube-api-access-8svnf\") pod \"payload-processing-5bf47cd988-56kvv\" (UID: \"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6\") " pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.293964 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.293875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129f2f-ec2c-4f40-8620-2a4078e4530d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fbd99\" (UID: \"bd129f2f-ec2c-4f40-8620-2a4078e4530d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.293964 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.293923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8svnf\" (UniqueName: \"kubernetes.io/projected/2f9ee006-33c0-463b-8d7b-1fd4cd83cde6-kube-api-access-8svnf\") pod \"payload-processing-5bf47cd988-56kvv\" (UID: \"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6\") " pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.294211 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.294055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfrjk\" (UniqueName: \"kubernetes.io/projected/bd129f2f-ec2c-4f40-8620-2a4078e4530d-kube-api-access-hfrjk\") pod \"payload-pre-processing-7677b774bb-fbd99\" (UID: \"bd129f2f-ec2c-4f40-8620-2a4078e4530d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.294211 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.294125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9ee006-33c0-463b-8d7b-1fd4cd83cde6-plugins-config-volume\") pod \"payload-processing-5bf47cd988-56kvv\" (UID: \"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6\") " pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.295016 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.294994    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f9ee006-33c0-463b-8d7b-1fd4cd83cde6-plugins-config-volume\") pod \"payload-processing-5bf47cd988-56kvv\" (UID: \"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6\") " pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.306620 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.306591    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8svnf\" (UniqueName: \"kubernetes.io/projected/2f9ee006-33c0-463b-8d7b-1fd4cd83cde6-kube-api-access-8svnf\") pod \"payload-processing-5bf47cd988-56kvv\" (UID: \"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6\") " pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.360730 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.360699    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:23.395514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.395475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129f2f-ec2c-4f40-8620-2a4078e4530d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fbd99\" (UID: \"bd129f2f-ec2c-4f40-8620-2a4078e4530d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.395689 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.395594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfrjk\" (UniqueName: \"kubernetes.io/projected/bd129f2f-ec2c-4f40-8620-2a4078e4530d-kube-api-access-hfrjk\") pod \"payload-pre-processing-7677b774bb-fbd99\" (UID: \"bd129f2f-ec2c-4f40-8620-2a4078e4530d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.396517 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.396489    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129f2f-ec2c-4f40-8620-2a4078e4530d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fbd99\" (UID: \"bd129f2f-ec2c-4f40-8620-2a4078e4530d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.405530 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.405477    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfrjk\" (UniqueName: \"kubernetes.io/projected/bd129f2f-ec2c-4f40-8620-2a4078e4530d-kube-api-access-hfrjk\") pod \"payload-pre-processing-7677b774bb-fbd99\" (UID: \"bd129f2f-ec2c-4f40-8620-2a4078e4530d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.429570 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.429539    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:23.544444 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.544316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-56kvv"]
Jul 21 02:08:23.545967 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:08:23.545933    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9ee006_33c0_463b_8d7b_1fd4cd83cde6.slice/crio-0fe3533aee9493e124f586f1571a39d72d66faff55a67e3633be06bd83fa6a32 WatchSource:0}: Error finding container 0fe3533aee9493e124f586f1571a39d72d66faff55a67e3633be06bd83fa6a32: Status 404 returned error can't find the container with id 0fe3533aee9493e124f586f1571a39d72d66faff55a67e3633be06bd83fa6a32
Jul 21 02:08:23.614926 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:08:23.614394    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd129f2f_ec2c_4f40_8620_2a4078e4530d.slice/crio-b184c20559f00bd919699dfd11710011a8058ec78c54f2fa226635bafbb22e32 WatchSource:0}: Error finding container b184c20559f00bd919699dfd11710011a8058ec78c54f2fa226635bafbb22e32: Status 404 returned error can't find the container with id b184c20559f00bd919699dfd11710011a8058ec78c54f2fa226635bafbb22e32
Jul 21 02:08:23.616535 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.616508    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fbd99"]
Jul 21 02:08:23.919451 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.919359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv" event={"ID":"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6","Type":"ContainerStarted","Data":"0fe3533aee9493e124f586f1571a39d72d66faff55a67e3633be06bd83fa6a32"}
Jul 21 02:08:23.921123 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:23.921058    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99" event={"ID":"bd129f2f-ec2c-4f40-8620-2a4078e4530d","Type":"ContainerStarted","Data":"b184c20559f00bd919699dfd11710011a8058ec78c54f2fa226635bafbb22e32"}
Jul 21 02:08:25.937899 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.937801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67" event={"ID":"77cc30a4-ec0e-4325-888c-d0dd4dea49f5","Type":"ContainerStarted","Data":"e2800be12cf7fd6605d5dfeabe5c486a10145370c8b23b03d8e4303b9b9309a8"}
Jul 21 02:08:25.938361 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.937933    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:25.940011 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.939980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99" event={"ID":"bd129f2f-ec2c-4f40-8620-2a4078e4530d","Type":"ContainerStarted","Data":"835aa06029871213b2fc516ebc3a3d1f1096d10b54a12bb3c41eb3aa3d44f563"}
Jul 21 02:08:25.940158 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.940104    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:25.941799 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.941776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv" event={"ID":"2f9ee006-33c0-463b-8d7b-1fd4cd83cde6","Type":"ContainerStarted","Data":"92010820d5d7331b742f4f297d4274d21d93d6f00fff3ab2fca3f6ed176fbff4"}
Jul 21 02:08:25.941915 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.941884    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:25.957947 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.957900    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67" podStartSLOduration=1.131813417 podStartE2EDuration="3.957886755s" totalImagesPullingTime="2.826073338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:25.956685279 +0000 UTC m=+873.698491621" watchObservedRunningTime="2026-07-21 02:08:25.957886755 +0000 UTC m=+873.699693095"
Jul 21 02:08:25.980631 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.980579    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv" podStartSLOduration=0.853722148 podStartE2EDuration="2.980561982s" totalImagesPullingTime="2.126839834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:25.976500978 +0000 UTC m=+873.718307319" watchObservedRunningTime="2026-07-21 02:08:25.980561982 +0000 UTC m=+873.722368324"
Jul 21 02:08:25.997468 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:25.997410    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99" podStartSLOduration=0.940789146 podStartE2EDuration="2.99739425s" totalImagesPullingTime="2.056605104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:25.994346256 +0000 UTC m=+873.736152597" watchObservedRunningTime="2026-07-21 02:08:25.99739425 +0000 UTC m=+873.739200590"
Jul 21 02:08:31.953016 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:31.952981    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6556977745-qgf67"
Jul 21 02:08:36.949908 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:36.949877    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-56kvv"
Jul 21 02:08:36.950398 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:36.950100    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fbd99"
Jul 21 02:08:39.783491 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.783454    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"]
Jul 21 02:08:39.788630 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.788605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.792517 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.792488    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 02:08:39.792670 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.792521    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rgs5g\""
Jul 21 02:08:39.792670 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.792532    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 02:08:39.792670 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.792489    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 02:08:39.798166 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.798143    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"]
Jul 21 02:08:39.839875 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.839840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.839875 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.839876    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.840073 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.839956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.840073 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.839997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c239d13c-6aa4-46cb-9b54-67901534a014-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.840073 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.840031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.840073 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.840067    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-627wr\" (UniqueName: \"kubernetes.io/projected/c239d13c-6aa4-46cb-9b54-67901534a014-kube-api-access-627wr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941119 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941119 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941409 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941409 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c239d13c-6aa4-46cb-9b54-67901534a014-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941409 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941409 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-627wr\" (UniqueName: \"kubernetes.io/projected/c239d13c-6aa4-46cb-9b54-67901534a014-kube-api-access-627wr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941664 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941591    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941664 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941616    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.941773 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.941679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.943622 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.943601    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c239d13c-6aa4-46cb-9b54-67901534a014-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.943754 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.943735    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c239d13c-6aa4-46cb-9b54-67901534a014-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:39.949348 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:39.949325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-627wr\" (UniqueName: \"kubernetes.io/projected/c239d13c-6aa4-46cb-9b54-67901534a014-kube-api-access-627wr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl\" (UID: \"c239d13c-6aa4-46cb-9b54-67901534a014\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:40.124573 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:40.124491    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:40.277649 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:40.277620    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"]
Jul 21 02:08:40.278561 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:08:40.278536    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc239d13c_6aa4_46cb_9b54_67901534a014.slice/crio-0618e97475e185633c34d42c46dbacad0407468bd4520679b59190321571a7bd WatchSource:0}: Error finding container 0618e97475e185633c34d42c46dbacad0407468bd4520679b59190321571a7bd: Status 404 returned error can't find the container with id 0618e97475e185633c34d42c46dbacad0407468bd4520679b59190321571a7bd
Jul 21 02:08:41.034725 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:41.034680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl" event={"ID":"c239d13c-6aa4-46cb-9b54-67901534a014","Type":"ContainerStarted","Data":"0618e97475e185633c34d42c46dbacad0407468bd4520679b59190321571a7bd"}
Jul 21 02:08:42.042395 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:42.042355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl" event={"ID":"c239d13c-6aa4-46cb-9b54-67901534a014","Type":"ContainerStarted","Data":"63b0706ea829add81bead8cea0d4f2fc35772f4e42e62a32b6880057fd54535d"}
Jul 21 02:08:42.063118 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:42.063043    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl" podStartSLOduration=1.9100476180000001 podStartE2EDuration="3.063027059s" totalImagesPullingTime="1.152979441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:42.061840672 +0000 UTC m=+889.803647015" watchObservedRunningTime="2026-07-21 02:08:42.063027059 +0000 UTC m=+889.804833400"
Jul 21 02:08:50.125103 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.125061    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:50.125652 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.125135    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:50.140274 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.140224    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:50.495288 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.495251    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"]
Jul 21 02:08:50.498899 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.498878    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.501792 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.501773    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 02:08:50.509196 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.509172    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"]
Jul 21 02:08:50.544912 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.544875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.545083 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.544918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.545083 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.544982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.545083 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.545014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpg5j\" (UniqueName: \"kubernetes.io/projected/27d2a54b-37fa-433a-a6e0-ce07bbe41449-kube-api-access-tpg5j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.545193 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.545087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.545193 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.545123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27d2a54b-37fa-433a-a6e0-ce07bbe41449-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.645661 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.645613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.645661 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.645664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27d2a54b-37fa-433a-a6e0-ce07bbe41449-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.645918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.645741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.645918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.645767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.645918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.645813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.645918 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.645845    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpg5j\" (UniqueName: \"kubernetes.io/projected/27d2a54b-37fa-433a-a6e0-ce07bbe41449-kube-api-access-tpg5j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.646192 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.646162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.646290 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.646214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.646290 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.646272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.648132 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.648098    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27d2a54b-37fa-433a-a6e0-ce07bbe41449-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.648263 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.648158    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27d2a54b-37fa-433a-a6e0-ce07bbe41449-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.657068 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.657043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpg5j\" (UniqueName: \"kubernetes.io/projected/27d2a54b-37fa-433a-a6e0-ce07bbe41449-kube-api-access-tpg5j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jlslj\" (UID: \"27d2a54b-37fa-433a-a6e0-ce07bbe41449\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.810493 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.810395    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:08:50.948855 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:50.948824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"]
Jul 21 02:08:50.950058 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:08:50.950033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d2a54b_37fa_433a_a6e0_ce07bbe41449.slice/crio-3209ed910d1114ae8a73cf822edb45f21056a70671bc58e4616006ef970d3c7a WatchSource:0}: Error finding container 3209ed910d1114ae8a73cf822edb45f21056a70671bc58e4616006ef970d3c7a: Status 404 returned error can't find the container with id 3209ed910d1114ae8a73cf822edb45f21056a70671bc58e4616006ef970d3c7a
Jul 21 02:08:51.096613 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:51.096521    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj" event={"ID":"27d2a54b-37fa-433a-a6e0-ce07bbe41449","Type":"ContainerStarted","Data":"3209ed910d1114ae8a73cf822edb45f21056a70671bc58e4616006ef970d3c7a"}
Jul 21 02:08:51.107921 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:51.107886    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl"
Jul 21 02:08:52.106120 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:52.106083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj" event={"ID":"27d2a54b-37fa-433a-a6e0-ce07bbe41449","Type":"ContainerStarted","Data":"48da38b20f2c56e89a8daf2c17eef616d7734a2dd2d29b722957af9206641531"}
Jul 21 02:08:52.124620 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:52.124559    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj" podStartSLOduration=1.914523363 podStartE2EDuration="2.124539391s" totalImagesPullingTime="210.016028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:52.123496725 +0000 UTC m=+899.865303071" watchObservedRunningTime="2026-07-21 02:08:52.124539391 +0000 UTC m=+899.866345734"
Jul 21 02:08:52.839891 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:52.839861    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:08:52.856130 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:52.856100    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:08:52.866387 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:52.866357    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:08:52.872500 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:08:52.872480    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:09:00.811125 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:00.811089    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:09:00.811726 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:00.811153    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:09:00.823795 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:00.823772    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:09:01.171801 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:01.171710    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jlslj"
Jul 21 02:09:20.492216 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.492175    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"]
Jul 21 02:09:20.496609 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.496589    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.499654 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.499623    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 02:09:20.506913 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.506887    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"]
Jul 21 02:09:20.507024 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.506962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69s2n\" (UniqueName: \"kubernetes.io/projected/19ed837b-773e-4894-ab06-4323a8d95dab-kube-api-access-69s2n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.507024 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.507005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.507126 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.507038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.507126 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.507082    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19ed837b-773e-4894-ab06-4323a8d95dab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.507126 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.507103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.507257 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.507150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.608513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19ed837b-773e-4894-ab06-4323a8d95dab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.608513 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.608769 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.608769 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69s2n\" (UniqueName: \"kubernetes.io/projected/19ed837b-773e-4894-ab06-4323a8d95dab-kube-api-access-69s2n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.608769 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.608769 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.609023 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.608996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.609087 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.609024    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.609087 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.609067    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.611056 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.611035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19ed837b-773e-4894-ab06-4323a8d95dab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.611274 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.611254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19ed837b-773e-4894-ab06-4323a8d95dab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.621668 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.621649    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69s2n\" (UniqueName: \"kubernetes.io/projected/19ed837b-773e-4894-ab06-4323a8d95dab-kube-api-access-69s2n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8\" (UID: \"19ed837b-773e-4894-ab06-4323a8d95dab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.808584 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.808494    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:20.950695 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.950659    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"]
Jul 21 02:09:20.951419 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:09:20.951393    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ed837b_773e_4894_ab06_4323a8d95dab.slice/crio-2d35464660e6d63e0f28030b3aba1d4618192ee65909cea06830172d278d4441 WatchSource:0}: Error finding container 2d35464660e6d63e0f28030b3aba1d4618192ee65909cea06830172d278d4441: Status 404 returned error can't find the container with id 2d35464660e6d63e0f28030b3aba1d4618192ee65909cea06830172d278d4441
Jul 21 02:09:20.952728 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:20.952713    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:09:21.275306 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:21.275264    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8" event={"ID":"19ed837b-773e-4894-ab06-4323a8d95dab","Type":"ContainerStarted","Data":"7becec976cb2afad843ae82d5b8abb8e2914a0e3843013bb50b8a7b3c5a4547c"}
Jul 21 02:09:21.275514 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:21.275321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8" event={"ID":"19ed837b-773e-4894-ab06-4323a8d95dab","Type":"ContainerStarted","Data":"2d35464660e6d63e0f28030b3aba1d4618192ee65909cea06830172d278d4441"}
Jul 21 02:09:21.293749 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:21.293695    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8" podStartSLOduration=1.122997418 podStartE2EDuration="1.293677263s" totalImagesPullingTime="170.679845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:21.293116022 +0000 UTC m=+929.034922363" watchObservedRunningTime="2026-07-21 02:09:21.293677263 +0000 UTC m=+929.035483608"
Jul 21 02:09:30.809283 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:30.809206    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:30.809711 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:30.809305    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:30.821949 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:30.821921    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:09:31.346485 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:09:31.346455    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8"
Jul 21 02:10:50.364758 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.364722    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-884d44c6c-psm8n"]
Jul 21 02:10:50.368624 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.368603    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.383784 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.383754    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-884d44c6c-psm8n"]
Jul 21 02:10:50.553792 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.553751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c55e1e08-c163-4135-a1a8-e827e8ad14b1-tls-cert\") pod \"authorino-884d44c6c-psm8n\" (UID: \"c55e1e08-c163-4135-a1a8-e827e8ad14b1\") " pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.553985 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.553938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn4lt\" (UniqueName: \"kubernetes.io/projected/c55e1e08-c163-4135-a1a8-e827e8ad14b1-kube-api-access-nn4lt\") pod \"authorino-884d44c6c-psm8n\" (UID: \"c55e1e08-c163-4135-a1a8-e827e8ad14b1\") " pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.655117 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.655025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn4lt\" (UniqueName: \"kubernetes.io/projected/c55e1e08-c163-4135-a1a8-e827e8ad14b1-kube-api-access-nn4lt\") pod \"authorino-884d44c6c-psm8n\" (UID: \"c55e1e08-c163-4135-a1a8-e827e8ad14b1\") " pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.655117 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.655072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c55e1e08-c163-4135-a1a8-e827e8ad14b1-tls-cert\") pod \"authorino-884d44c6c-psm8n\" (UID: \"c55e1e08-c163-4135-a1a8-e827e8ad14b1\") " pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.657641 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.657609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c55e1e08-c163-4135-a1a8-e827e8ad14b1-tls-cert\") pod \"authorino-884d44c6c-psm8n\" (UID: \"c55e1e08-c163-4135-a1a8-e827e8ad14b1\") " pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.664609 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.664579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn4lt\" (UniqueName: \"kubernetes.io/projected/c55e1e08-c163-4135-a1a8-e827e8ad14b1-kube-api-access-nn4lt\") pod \"authorino-884d44c6c-psm8n\" (UID: \"c55e1e08-c163-4135-a1a8-e827e8ad14b1\") " pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.677497 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.677465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-884d44c6c-psm8n"
Jul 21 02:10:50.827784 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:50.827746    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-884d44c6c-psm8n"]
Jul 21 02:10:50.829353 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:10:50.829330    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc55e1e08_c163_4135_a1a8_e827e8ad14b1.slice/crio-4b133516179d3d8e1d0aa3ba45101f020efc30d5e20ff5fcc0e5fc1dbe2b7c69 WatchSource:0}: Error finding container 4b133516179d3d8e1d0aa3ba45101f020efc30d5e20ff5fcc0e5fc1dbe2b7c69: Status 404 returned error can't find the container with id 4b133516179d3d8e1d0aa3ba45101f020efc30d5e20ff5fcc0e5fc1dbe2b7c69
Jul 21 02:10:51.805611 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:51.805558    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-884d44c6c-psm8n" event={"ID":"c55e1e08-c163-4135-a1a8-e827e8ad14b1","Type":"ContainerStarted","Data":"a2e8a8ba2f684f9e015316881f33e0b742201d27f8dd9af56e6d6db6d6db98e0"}
Jul 21 02:10:51.806537 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:51.806510    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-884d44c6c-psm8n" event={"ID":"c55e1e08-c163-4135-a1a8-e827e8ad14b1","Type":"ContainerStarted","Data":"4b133516179d3d8e1d0aa3ba45101f020efc30d5e20ff5fcc0e5fc1dbe2b7c69"}
Jul 21 02:10:51.831792 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:51.831737    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-884d44c6c-psm8n" podStartSLOduration=1.405060231 podStartE2EDuration="1.831720301s" totalImagesPullingTime="426.66007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:51.827858598 +0000 UTC m=+1019.569664945" watchObservedRunningTime="2026-07-21 02:10:51.831720301 +0000 UTC m=+1019.573526641"
Jul 21 02:10:51.926329 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:51.926296    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d6c85dd7d-qf9cb"]
Jul 21 02:10:51.926540 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:51.926514    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb" podUID="24930647-2c41-4b89-b5db-4e05422e283d" containerName="authorino" containerID="cri-o://99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d" gracePeriod=30
Jul 21 02:10:52.196843 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.196803    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:10:52.373631 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.373545    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz8fb\" (UniqueName: \"kubernetes.io/projected/24930647-2c41-4b89-b5db-4e05422e283d-kube-api-access-jz8fb\") pod \"24930647-2c41-4b89-b5db-4e05422e283d\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") "
Jul 21 02:10:52.373631 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.373612    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24930647-2c41-4b89-b5db-4e05422e283d-tls-cert\") pod \"24930647-2c41-4b89-b5db-4e05422e283d\" (UID: \"24930647-2c41-4b89-b5db-4e05422e283d\") "
Jul 21 02:10:52.375803 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.375767    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24930647-2c41-4b89-b5db-4e05422e283d-kube-api-access-jz8fb" (OuterVolumeSpecName: "kube-api-access-jz8fb") pod "24930647-2c41-4b89-b5db-4e05422e283d" (UID: "24930647-2c41-4b89-b5db-4e05422e283d"). InnerVolumeSpecName "kube-api-access-jz8fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:10:52.385872 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.385840    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24930647-2c41-4b89-b5db-4e05422e283d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "24930647-2c41-4b89-b5db-4e05422e283d" (UID: "24930647-2c41-4b89-b5db-4e05422e283d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:10:52.474704 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.474664    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz8fb\" (UniqueName: \"kubernetes.io/projected/24930647-2c41-4b89-b5db-4e05422e283d-kube-api-access-jz8fb\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:10:52.474937 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.474921    2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24930647-2c41-4b89-b5db-4e05422e283d-tls-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:10:52.814403 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.814366    2574 generic.go:356] "Generic (PLEG): container finished" podID="24930647-2c41-4b89-b5db-4e05422e283d" containerID="99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d" exitCode=0
Jul 21 02:10:52.814839 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.814418    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb"
Jul 21 02:10:52.814839 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.814451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb" event={"ID":"24930647-2c41-4b89-b5db-4e05422e283d","Type":"ContainerDied","Data":"99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d"}
Jul 21 02:10:52.814839 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.814497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d6c85dd7d-qf9cb" event={"ID":"24930647-2c41-4b89-b5db-4e05422e283d","Type":"ContainerDied","Data":"2fdb395fa948e860ba96a3b3119dea3a794e37b5086bcc95efec6ea67575a513"}
Jul 21 02:10:52.814839 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.814519    2574 scope.go:117] "RemoveContainer" containerID="99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d"
Jul 21 02:10:52.826306 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.826219    2574 scope.go:117] "RemoveContainer" containerID="99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d"
Jul 21 02:10:52.826562 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:10:52.826541    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d\": container with ID starting with 99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d not found: ID does not exist" containerID="99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d"
Jul 21 02:10:52.826621 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.826571    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d"} err="failed to get container status \"99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d\": rpc error: code = NotFound desc = could not find container \"99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d\": container with ID starting with 99e0d7c2df3782058afd6ac63baa3acb0eb805f2c6027321ede6affcea48a35d not found: ID does not exist"
Jul 21 02:10:52.853523 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.853491    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d6c85dd7d-qf9cb"]
Jul 21 02:10:52.858174 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:52.858146    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d6c85dd7d-qf9cb"]
Jul 21 02:10:53.023921 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:10:53.023892    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24930647-2c41-4b89-b5db-4e05422e283d" path="/var/lib/kubelet/pods/24930647-2c41-4b89-b5db-4e05422e283d/volumes"
Jul 21 02:12:15.778039 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:15.778008    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54fc764664-fzzn2"]
Jul 21 02:12:15.778575 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:15.778224    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54fc764664-fzzn2" podUID="ae6c8e30-9c86-4d93-a495-86db3e6f21a8" containerName="manager" containerID="cri-o://379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4" gracePeriod=30
Jul 21 02:12:16.040152 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.040090    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:12:16.156352 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.156320    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-webhook-cert\") pod \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") "
Jul 21 02:12:16.156534 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.156376    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mb2g\" (UniqueName: \"kubernetes.io/projected/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-kube-api-access-4mb2g\") pod \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\" (UID: \"ae6c8e30-9c86-4d93-a495-86db3e6f21a8\") "
Jul 21 02:12:16.158589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.158559    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae6c8e30-9c86-4d93-a495-86db3e6f21a8" (UID: "ae6c8e30-9c86-4d93-a495-86db3e6f21a8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:12:16.158589 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.158560    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-kube-api-access-4mb2g" (OuterVolumeSpecName: "kube-api-access-4mb2g") pod "ae6c8e30-9c86-4d93-a495-86db3e6f21a8" (UID: "ae6c8e30-9c86-4d93-a495-86db3e6f21a8"). InnerVolumeSpecName "kube-api-access-4mb2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:12:16.258156 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.258123    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-webhook-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:12:16.258156 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.258152    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mb2g\" (UniqueName: \"kubernetes.io/projected/ae6c8e30-9c86-4d93-a495-86db3e6f21a8-kube-api-access-4mb2g\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:12:16.317650 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.317566    2574 generic.go:356] "Generic (PLEG): container finished" podID="ae6c8e30-9c86-4d93-a495-86db3e6f21a8" containerID="379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4" exitCode=0
Jul 21 02:12:16.317650 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.317608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-fzzn2" event={"ID":"ae6c8e30-9c86-4d93-a495-86db3e6f21a8","Type":"ContainerDied","Data":"379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4"}
Jul 21 02:12:16.317650 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.317613    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-fzzn2"
Jul 21 02:12:16.317650 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.317649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-fzzn2" event={"ID":"ae6c8e30-9c86-4d93-a495-86db3e6f21a8","Type":"ContainerDied","Data":"b5b23043b4fdf85766e313417336aa746fb0229f676f8ee42952a977fc4b89af"}
Jul 21 02:12:16.318002 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.317670    2574 scope.go:117] "RemoveContainer" containerID="379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4"
Jul 21 02:12:16.327641 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.327623    2574 scope.go:117] "RemoveContainer" containerID="379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4"
Jul 21 02:12:16.327914 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:12:16.327892    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4\": container with ID starting with 379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4 not found: ID does not exist" containerID="379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4"
Jul 21 02:12:16.327961 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.327923    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4"} err="failed to get container status \"379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4\": rpc error: code = NotFound desc = could not find container \"379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4\": container with ID starting with 379a840dcb40feb941eb3e6b6afc425f10e6feb80254e9af2746d99a7b6ad0f4 not found: ID does not exist"
Jul 21 02:12:16.341296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.341258    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54fc764664-fzzn2"]
Jul 21 02:12:16.349777 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:16.349745    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54fc764664-fzzn2"]
Jul 21 02:12:17.022471 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:12:17.022438    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae6c8e30-9c86-4d93-a495-86db3e6f21a8" path="/var/lib/kubelet/pods/ae6c8e30-9c86-4d93-a495-86db3e6f21a8/volumes"
Jul 21 02:13:17.142782 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.142744    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54fc764664-9j62w"]
Jul 21 02:13:17.143203 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.143189    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6c8e30-9c86-4d93-a495-86db3e6f21a8" containerName="manager"
Jul 21 02:13:17.143203 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.143202    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6c8e30-9c86-4d93-a495-86db3e6f21a8" containerName="manager"
Jul 21 02:13:17.143299 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.143227    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24930647-2c41-4b89-b5db-4e05422e283d" containerName="authorino"
Jul 21 02:13:17.143299 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.143246    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="24930647-2c41-4b89-b5db-4e05422e283d" containerName="authorino"
Jul 21 02:13:17.143363 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.143310    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae6c8e30-9c86-4d93-a495-86db3e6f21a8" containerName="manager"
Jul 21 02:13:17.143363 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.143321    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="24930647-2c41-4b89-b5db-4e05422e283d" containerName="authorino"
Jul 21 02:13:17.147655 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.147634    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.150169 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.150140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 02:13:17.150400 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.150380    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4vz2t\""
Jul 21 02:13:17.150543 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.150526    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 02:13:17.156097 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.156073    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54fc764664-9j62w"]
Jul 21 02:13:17.212301 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.212264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbfp5\" (UniqueName: \"kubernetes.io/projected/04cbac14-2999-449b-8827-2aa1156c0ea6-kube-api-access-bbfp5\") pod \"maas-controller-54fc764664-9j62w\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") " pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.212469 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.212353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04cbac14-2999-449b-8827-2aa1156c0ea6-webhook-cert\") pod \"maas-controller-54fc764664-9j62w\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") " pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.312944 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.312901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbfp5\" (UniqueName: \"kubernetes.io/projected/04cbac14-2999-449b-8827-2aa1156c0ea6-kube-api-access-bbfp5\") pod \"maas-controller-54fc764664-9j62w\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") " pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.313122 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.313007    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04cbac14-2999-449b-8827-2aa1156c0ea6-webhook-cert\") pod \"maas-controller-54fc764664-9j62w\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") " pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.315492 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.315470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04cbac14-2999-449b-8827-2aa1156c0ea6-webhook-cert\") pod \"maas-controller-54fc764664-9j62w\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") " pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.321436 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.321413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbfp5\" (UniqueName: \"kubernetes.io/projected/04cbac14-2999-449b-8827-2aa1156c0ea6-kube-api-access-bbfp5\") pod \"maas-controller-54fc764664-9j62w\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") " pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.460221 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.460146    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:17.602980 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.602947    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54fc764664-9j62w"]
Jul 21 02:13:17.603847 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:13:17.603814    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cbac14_2999_449b_8827_2aa1156c0ea6.slice/crio-2a43127add8d0bc056eb22d041d8ec43647c594f49195e57c0f830440a7ec66b WatchSource:0}: Error finding container 2a43127add8d0bc056eb22d041d8ec43647c594f49195e57c0f830440a7ec66b: Status 404 returned error can't find the container with id 2a43127add8d0bc056eb22d041d8ec43647c594f49195e57c0f830440a7ec66b
Jul 21 02:13:17.676071 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:17.676025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-9j62w" event={"ID":"04cbac14-2999-449b-8827-2aa1156c0ea6","Type":"ContainerStarted","Data":"2a43127add8d0bc056eb22d041d8ec43647c594f49195e57c0f830440a7ec66b"}
Jul 21 02:13:18.683734 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:18.683699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-9j62w" event={"ID":"04cbac14-2999-449b-8827-2aa1156c0ea6","Type":"ContainerStarted","Data":"4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54"}
Jul 21 02:13:18.684218 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:18.683771    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:18.703485 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:18.703426    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54fc764664-9j62w" podStartSLOduration=1.2902922860000001 podStartE2EDuration="1.703411013s" totalImagesPullingTime="413.118727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:13:18.700395669 +0000 UTC m=+1166.442202000" watchObservedRunningTime="2026-07-21 02:13:18.703411013 +0000 UTC m=+1166.445217354"
Jul 21 02:13:29.692260 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:29.692215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:34.338853 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.338816    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54fc764664-9j62w"]
Jul 21 02:13:34.339338 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.339024    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54fc764664-9j62w" podUID="04cbac14-2999-449b-8827-2aa1156c0ea6" containerName="manager" containerID="cri-o://4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54" gracePeriod=30
Jul 21 02:13:34.593184 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.593126    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:34.671067 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.671030    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04cbac14-2999-449b-8827-2aa1156c0ea6-webhook-cert\") pod \"04cbac14-2999-449b-8827-2aa1156c0ea6\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") "
Jul 21 02:13:34.671273 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.671141    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbfp5\" (UniqueName: \"kubernetes.io/projected/04cbac14-2999-449b-8827-2aa1156c0ea6-kube-api-access-bbfp5\") pod \"04cbac14-2999-449b-8827-2aa1156c0ea6\" (UID: \"04cbac14-2999-449b-8827-2aa1156c0ea6\") "
Jul 21 02:13:34.673054 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.673021    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04cbac14-2999-449b-8827-2aa1156c0ea6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "04cbac14-2999-449b-8827-2aa1156c0ea6" (UID: "04cbac14-2999-449b-8827-2aa1156c0ea6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:13:34.673156 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.673050    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04cbac14-2999-449b-8827-2aa1156c0ea6-kube-api-access-bbfp5" (OuterVolumeSpecName: "kube-api-access-bbfp5") pod "04cbac14-2999-449b-8827-2aa1156c0ea6" (UID: "04cbac14-2999-449b-8827-2aa1156c0ea6"). InnerVolumeSpecName "kube-api-access-bbfp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:13:34.771794 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.771759    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04cbac14-2999-449b-8827-2aa1156c0ea6-webhook-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:13:34.771794 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.771788    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbfp5\" (UniqueName: \"kubernetes.io/projected/04cbac14-2999-449b-8827-2aa1156c0ea6-kube-api-access-bbfp5\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 21 02:13:34.783063 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.783029    2574 generic.go:356] "Generic (PLEG): container finished" podID="04cbac14-2999-449b-8827-2aa1156c0ea6" containerID="4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54" exitCode=0
Jul 21 02:13:34.783204 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.783075    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-9j62w"
Jul 21 02:13:34.783204 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.783121    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-9j62w" event={"ID":"04cbac14-2999-449b-8827-2aa1156c0ea6","Type":"ContainerDied","Data":"4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54"}
Jul 21 02:13:34.783204 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.783175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-9j62w" event={"ID":"04cbac14-2999-449b-8827-2aa1156c0ea6","Type":"ContainerDied","Data":"2a43127add8d0bc056eb22d041d8ec43647c594f49195e57c0f830440a7ec66b"}
Jul 21 02:13:34.783204 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.783199    2574 scope.go:117] "RemoveContainer" containerID="4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54"
Jul 21 02:13:34.793059 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.793040    2574 scope.go:117] "RemoveContainer" containerID="4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54"
Jul 21 02:13:34.793331 ip-10-0-141-1 kubenswrapper[2574]: E0721 02:13:34.793311    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54\": container with ID starting with 4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54 not found: ID does not exist" containerID="4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54"
Jul 21 02:13:34.793404 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.793341    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54"} err="failed to get container status \"4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54\": rpc error: code = NotFound desc = could not find container \"4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54\": container with ID starting with 4ce9f9e68997e4a2a9f362dae5c1f0d6898ca87a970a30ec2d7bb35666ea4a54 not found: ID does not exist"
Jul 21 02:13:34.806941 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.806907    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54fc764664-9j62w"]
Jul 21 02:13:34.809529 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:34.809502    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54fc764664-9j62w"]
Jul 21 02:13:35.022576 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.022544    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04cbac14-2999-449b-8827-2aa1156c0ea6" path="/var/lib/kubelet/pods/04cbac14-2999-449b-8827-2aa1156c0ea6/volumes"
Jul 21 02:13:35.550456 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.550416    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54fc764664-vk6wf"]
Jul 21 02:13:35.550954 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.550937    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04cbac14-2999-449b-8827-2aa1156c0ea6" containerName="manager"
Jul 21 02:13:35.551025 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.550956    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="04cbac14-2999-449b-8827-2aa1156c0ea6" containerName="manager"
Jul 21 02:13:35.551073 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.551051    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="04cbac14-2999-449b-8827-2aa1156c0ea6" containerName="manager"
Jul 21 02:13:35.555420 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.555401    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.559274 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.559249    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 02:13:35.559446 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.559288    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 02:13:35.559608 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.559579    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4vz2t\""
Jul 21 02:13:35.563296 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.563271    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54fc764664-vk6wf"]
Jul 21 02:13:35.679497 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.679456    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7s9\" (UniqueName: \"kubernetes.io/projected/51ad44f8-a820-4294-9fbe-c5a232d9a559-kube-api-access-4d7s9\") pod \"maas-controller-54fc764664-vk6wf\" (UID: \"51ad44f8-a820-4294-9fbe-c5a232d9a559\") " pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.679670 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.679512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51ad44f8-a820-4294-9fbe-c5a232d9a559-webhook-cert\") pod \"maas-controller-54fc764664-vk6wf\" (UID: \"51ad44f8-a820-4294-9fbe-c5a232d9a559\") " pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.780356 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.780322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7s9\" (UniqueName: \"kubernetes.io/projected/51ad44f8-a820-4294-9fbe-c5a232d9a559-kube-api-access-4d7s9\") pod \"maas-controller-54fc764664-vk6wf\" (UID: \"51ad44f8-a820-4294-9fbe-c5a232d9a559\") " pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.780522 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.780372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51ad44f8-a820-4294-9fbe-c5a232d9a559-webhook-cert\") pod \"maas-controller-54fc764664-vk6wf\" (UID: \"51ad44f8-a820-4294-9fbe-c5a232d9a559\") " pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.782666 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.782639    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51ad44f8-a820-4294-9fbe-c5a232d9a559-webhook-cert\") pod \"maas-controller-54fc764664-vk6wf\" (UID: \"51ad44f8-a820-4294-9fbe-c5a232d9a559\") " pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.791265 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.791047    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7s9\" (UniqueName: \"kubernetes.io/projected/51ad44f8-a820-4294-9fbe-c5a232d9a559-kube-api-access-4d7s9\") pod \"maas-controller-54fc764664-vk6wf\" (UID: \"51ad44f8-a820-4294-9fbe-c5a232d9a559\") " pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:35.866541 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:35.866449    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:36.003419 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:36.003388    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54fc764664-vk6wf"]
Jul 21 02:13:36.004660 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:13:36.004635    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ad44f8_a820_4294_9fbe_c5a232d9a559.slice/crio-61cd07eb2a731f8cfddcdf305816db6b5ed4fbc331674e3f3fce9502ec8c3d16 WatchSource:0}: Error finding container 61cd07eb2a731f8cfddcdf305816db6b5ed4fbc331674e3f3fce9502ec8c3d16: Status 404 returned error can't find the container with id 61cd07eb2a731f8cfddcdf305816db6b5ed4fbc331674e3f3fce9502ec8c3d16
Jul 21 02:13:36.801732 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:36.801686    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-vk6wf" event={"ID":"51ad44f8-a820-4294-9fbe-c5a232d9a559","Type":"ContainerStarted","Data":"794bab31b2b961cd888cdb5199e5d60d5a6806f4488badf517371caf172e9ce0"}
Jul 21 02:13:36.802123 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:36.801755    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54fc764664-vk6wf" event={"ID":"51ad44f8-a820-4294-9fbe-c5a232d9a559","Type":"ContainerStarted","Data":"61cd07eb2a731f8cfddcdf305816db6b5ed4fbc331674e3f3fce9502ec8c3d16"}
Jul 21 02:13:36.802123 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:36.801784    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:36.822363 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:36.822304    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54fc764664-vk6wf" podStartSLOduration=1.424244958 podStartE2EDuration="1.822287733s" totalImagesPullingTime="398.042775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:13:36.819867214 +0000 UTC m=+1184.561673555" watchObservedRunningTime="2026-07-21 02:13:36.822287733 +0000 UTC m=+1184.564094075"
Jul 21 02:13:47.810934 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:47.810895    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54fc764664-vk6wf"
Jul 21 02:13:52.893789 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:52.893760    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:13:52.899723 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:52.899700    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:13:52.905515 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:52.905497    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:13:52.910848 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:13:52.910832    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:18:52.943999 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:18:52.943973    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:18:52.950169 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:18:52.950140    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:18:52.951607 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:18:52.951585    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:18:52.957634 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:18:52.957617    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:23:52.985892 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:23:52.985863    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:23:52.990672 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:23:52.990647    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:23:52.992532 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:23:52.992511    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:23:52.996455 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:23:52.996433    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwj67_21953ca5-c250-48bf-8821-bc46c0774161/ovn-acl-logging/0.log"
Jul 21 02:26:05.386044 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:05.386009    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-884d44c6c-psm8n_c55e1e08-c163-4135-a1a8-e827e8ad14b1/authorino/0.log"
Jul 21 02:26:10.913542 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:10.913511    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-94m2r_bb330596-015e-4e7b-8640-9ea6c9c83891/manager/0.log"
Jul 21 02:26:11.042257 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:11.042210    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2p7t7_d1b48bfc-96e1-4d66-85b4-17841b902ff1/manager/0.log"
Jul 21 02:26:11.173880 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:11.173779    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54fc764664-vk6wf_51ad44f8-a820-4294-9fbe-c5a232d9a559/manager/0.log"
Jul 21 02:26:11.294074 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:11.294048    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zltrl_0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4/server/0.log"
Jul 21 02:26:11.424672 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:11.424600    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fzbtc_4633258f-49d6-4967-8739-04527475dd1f/manager/0.log"
Jul 21 02:26:11.867324 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:11.867296    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c97f6b6f9-n22sn_8a3c4d29-ab23-4a26-9672-efd214c79e2a/copy-manifests/0.log"
Jul 21 02:26:11.875786 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:11.875760    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c97f6b6f9-n22sn_8a3c4d29-ab23-4a26-9672-efd214c79e2a/manager/0.log"
Jul 21 02:26:12.229778 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:12.229743    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6556977745-qgf67_77cc30a4-ec0e-4325-888c-d0dd4dea49f5/maas-api/0.log"
Jul 21 02:26:12.465442 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:12.465412    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sdhvt_172ccbc0-858b-427a-b099-cbd52fda7b6a/postgres/0.log"
Jul 21 02:26:13.261641 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.261602    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8_808df566-8874-4900-9d7a-287781ef1f2d/extract/0.log"
Jul 21 02:26:13.269150 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.269121    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8_808df566-8874-4900-9d7a-287781ef1f2d/util/0.log"
Jul 21 02:26:13.276116 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.276095    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8_808df566-8874-4900-9d7a-287781ef1f2d/pull/0.log"
Jul 21 02:26:13.398360 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.398338    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj_3eed30d8-c68f-4368-9cbd-ed7963b8d36e/util/0.log"
Jul 21 02:26:13.406186 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.406160    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj_3eed30d8-c68f-4368-9cbd-ed7963b8d36e/pull/0.log"
Jul 21 02:26:13.416595 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.416573    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj_3eed30d8-c68f-4368-9cbd-ed7963b8d36e/extract/0.log"
Jul 21 02:26:13.539058 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.538966    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv_d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a/pull/0.log"
Jul 21 02:26:13.546628 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.546599    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv_d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a/extract/0.log"
Jul 21 02:26:13.553290 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.553269    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv_d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a/util/0.log"
Jul 21 02:26:13.687890 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.687860    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx_cc9cc202-3ffb-466e-84b9-abc113f2f3b2/extract/0.log"
Jul 21 02:26:13.713834 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.713804    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx_cc9cc202-3ffb-466e-84b9-abc113f2f3b2/util/0.log"
Jul 21 02:26:13.723573 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.723551    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx_cc9cc202-3ffb-466e-84b9-abc113f2f3b2/pull/0.log"
Jul 21 02:26:13.851839 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.851762    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-884d44c6c-psm8n_c55e1e08-c163-4135-a1a8-e827e8ad14b1/authorino/0.log"
Jul 21 02:26:13.999941 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:13.999885    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qhjwk_3ddcedbe-c31f-424c-8671-2fad59cc7a93/manager/0.log"
Jul 21 02:26:14.127652 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:14.127581    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6hqfx_6a2724ea-ceb2-491e-9854-5bfbc9683228/manager/0.log"
Jul 21 02:26:14.364578 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:14.364537    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zp28r_0eb9134e-7914-4f9d-aae2-11410e8c3534/registry-server/0.log"
Jul 21 02:26:14.759602 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:14.759569    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jrr58_e7547401-3b87-4a4b-8f4e-8177c9ea20b7/manager/0.log"
Jul 21 02:26:15.350323 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:15.350282    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b99b8fb9b-6247r_1ee0ba38-d648-4ffe-8f17-cad090e04748/kube-auth-proxy/0.log"
Jul 21 02:26:15.744267 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:15.744203    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fbd99_bd129f2f-ec2c-4f40-8620-2a4078e4530d/payload-pre-processing/0.log"
Jul 21 02:26:15.875642 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:15.875610    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-56kvv_2f9ee006-33c0-463b-8d7b-1fd4cd83cde6/payload-processing/0.log"
Jul 21 02:26:15.994029 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:15.994001    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69778848fd-sbjnc_f7ef1d90-623b-49cf-92d0-7d85ca88d545/router/0.log"
Jul 21 02:26:16.357469 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:16.357433    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4r8hl_c239d13c-6aa4-46cb-9b54-67901534a014/main/0.log"
Jul 21 02:26:16.604737 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:16.604704    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jlslj_27d2a54b-37fa-433a-a6e0-ce07bbe41449/main/0.log"
Jul 21 02:26:16.724218 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:16.724183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxc4n8_19ed837b-773e-4894-ab06-4323a8d95dab/main/0.log"
Jul 21 02:26:25.727889 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:25.727857    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r7st8_5568fc66-bd91-4463-aa4b-d06acc5ee517/global-pull-secret-syncer/0.log"
Jul 21 02:26:25.897922 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:25.897893    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vhmcl_d43fad76-9737-4cdf-ad01-0d4bbce7c011/konnectivity-agent/0.log"
Jul 21 02:26:26.012178 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:26.012092    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-1.ec2.internal_8164ea24c973945e2299d7670db9fc95/haproxy/0.log"
Jul 21 02:26:30.539142 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.539109    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8_808df566-8874-4900-9d7a-287781ef1f2d/extract/0.log"
Jul 21 02:26:30.562665 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.562637    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8_808df566-8874-4900-9d7a-287781ef1f2d/util/0.log"
Jul 21 02:26:30.592030 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.591995    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nt8p8_808df566-8874-4900-9d7a-287781ef1f2d/pull/0.log"
Jul 21 02:26:30.624611 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.624588    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj_3eed30d8-c68f-4368-9cbd-ed7963b8d36e/extract/0.log"
Jul 21 02:26:30.649008 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.648979    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj_3eed30d8-c68f-4368-9cbd-ed7963b8d36e/util/0.log"
Jul 21 02:26:30.675268 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.675244    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mvmdj_3eed30d8-c68f-4368-9cbd-ed7963b8d36e/pull/0.log"
Jul 21 02:26:30.704637 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.704606    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv_d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a/extract/0.log"
Jul 21 02:26:30.727778 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.727747    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv_d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a/util/0.log"
Jul 21 02:26:30.758260 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.758208    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zh6tv_d71bfc75-0dee-4cf5-baf3-ec6a2f17f44a/pull/0.log"
Jul 21 02:26:30.787942 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.787916    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx_cc9cc202-3ffb-466e-84b9-abc113f2f3b2/extract/0.log"
Jul 21 02:26:30.818739 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.818670    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx_cc9cc202-3ffb-466e-84b9-abc113f2f3b2/util/0.log"
Jul 21 02:26:30.844806 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:30.844778    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rmnqx_cc9cc202-3ffb-466e-84b9-abc113f2f3b2/pull/0.log"
Jul 21 02:26:31.265622 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:31.265581    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-884d44c6c-psm8n_c55e1e08-c163-4135-a1a8-e827e8ad14b1/authorino/0.log"
Jul 21 02:26:31.302194 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:31.302160    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qhjwk_3ddcedbe-c31f-424c-8671-2fad59cc7a93/manager/0.log"
Jul 21 02:26:31.339637 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:31.339615    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6hqfx_6a2724ea-ceb2-491e-9854-5bfbc9683228/manager/0.log"
Jul 21 02:26:31.434437 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:31.434403    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zp28r_0eb9134e-7914-4f9d-aae2-11410e8c3534/registry-server/0.log"
Jul 21 02:26:31.658612 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:31.658531    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jrr58_e7547401-3b87-4a4b-8f4e-8177c9ea20b7/manager/0.log"
Jul 21 02:26:33.642550 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:33.642521    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2dbgx_f3a69458-b8bf-4c5c-a343-8bd00877ca2e/kube-state-metrics/0.log"
Jul 21 02:26:33.686067 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:33.686035    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2dbgx_f3a69458-b8bf-4c5c-a343-8bd00877ca2e/kube-rbac-proxy-main/0.log"
Jul 21 02:26:33.754334 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:33.754304    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2dbgx_f3a69458-b8bf-4c5c-a343-8bd00877ca2e/kube-rbac-proxy-self/0.log"
Jul 21 02:26:34.133578 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.133548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zptjp_75bb4c15-e30e-4c36-a026-f4af21128e66/node-exporter/0.log"
Jul 21 02:26:34.164516 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.164488    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zptjp_75bb4c15-e30e-4c36-a026-f4af21128e66/kube-rbac-proxy/0.log"
Jul 21 02:26:34.198857 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.198828    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zptjp_75bb4c15-e30e-4c36-a026-f4af21128e66/init-textfile/0.log"
Jul 21 02:26:34.241041 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.241008    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vh8rv_f011eba4-1f12-402c-9516-242892c1f187/kube-rbac-proxy-main/0.log"
Jul 21 02:26:34.275526 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.275500    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vh8rv_f011eba4-1f12-402c-9516-242892c1f187/kube-rbac-proxy-self/0.log"
Jul 21 02:26:34.302072 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.302042    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vh8rv_f011eba4-1f12-402c-9516-242892c1f187/openshift-state-metrics/0.log"
Jul 21 02:26:34.755447 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.755415    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f9f86975-shkmd_912914b4-a201-4a7a-88cf-5be293862ba2/thanos-query/0.log"
Jul 21 02:26:34.779668 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.779643    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f9f86975-shkmd_912914b4-a201-4a7a-88cf-5be293862ba2/kube-rbac-proxy-web/0.log"
Jul 21 02:26:34.816090 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.816064    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f9f86975-shkmd_912914b4-a201-4a7a-88cf-5be293862ba2/kube-rbac-proxy/0.log"
Jul 21 02:26:34.855570 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.855544    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f9f86975-shkmd_912914b4-a201-4a7a-88cf-5be293862ba2/prom-label-proxy/0.log"
Jul 21 02:26:34.900749 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.900725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f9f86975-shkmd_912914b4-a201-4a7a-88cf-5be293862ba2/kube-rbac-proxy-rules/0.log"
Jul 21 02:26:34.940948 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:34.940919    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f9f86975-shkmd_912914b4-a201-4a7a-88cf-5be293862ba2/kube-rbac-proxy-metrics/0.log"
Jul 21 02:26:35.087441 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.087361    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"]
Jul 21 02:26:35.091005 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.090985    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.094059 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.094040    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvkpq\"/\"kube-root-ca.crt\""
Jul 21 02:26:35.094165 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.094067    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvkpq\"/\"openshift-service-ca.crt\""
Jul 21 02:26:35.095276 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.095255    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tvkpq\"/\"default-dockercfg-tq2w7\""
Jul 21 02:26:35.103560 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.103534    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"]
Jul 21 02:26:35.178113 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.178074    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-proc\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.178341 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.178147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-podres\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.178341 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.178176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpwvs\" (UniqueName: \"kubernetes.io/projected/2cc15dec-a456-4e33-bb25-d2ff313f71e1-kube-api-access-zpwvs\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.178341 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.178252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-lib-modules\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.178539 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.178370    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-sys\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279226 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-sys\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279445 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-proc\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279445 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-podres\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279445 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279339    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-sys\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279445 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpwvs\" (UniqueName: \"kubernetes.io/projected/2cc15dec-a456-4e33-bb25-d2ff313f71e1-kube-api-access-zpwvs\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279445 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-proc\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279640 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-lib-modules\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279640 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-podres\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.279640 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.279528    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cc15dec-a456-4e33-bb25-d2ff313f71e1-lib-modules\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.288593 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.288568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpwvs\" (UniqueName: \"kubernetes.io/projected/2cc15dec-a456-4e33-bb25-d2ff313f71e1-kube-api-access-zpwvs\") pod \"perf-node-gather-daemonset-pfkbg\" (UID: \"2cc15dec-a456-4e33-bb25-d2ff313f71e1\") " pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.402153 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.402040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:35.545159 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:35.545132    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"]
Jul 21 02:26:35.546653 ip-10-0-141-1 kubenswrapper[2574]: W0721 02:26:35.546625    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cc15dec_a456_4e33_bb25_d2ff313f71e1.slice/crio-4319585b075e5e88d37a59a9fe21cf6657490daab8e25b92451f33a70dbb8739 WatchSource:0}: Error finding container 4319585b075e5e88d37a59a9fe21cf6657490daab8e25b92451f33a70dbb8739: Status 404 returned error can't find the container with id 4319585b075e5e88d37a59a9fe21cf6657490daab8e25b92451f33a70dbb8739
Jul 21 02:26:36.410540 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:36.410501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg" event={"ID":"2cc15dec-a456-4e33-bb25-d2ff313f71e1","Type":"ContainerStarted","Data":"64848b2191f8e65eff53817d6b885f8397415c1f12484e7d10d672ea35eebf9b"}
Jul 21 02:26:36.411004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:36.410562    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:36.411004 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:36.410582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg" event={"ID":"2cc15dec-a456-4e33-bb25-d2ff313f71e1","Type":"ContainerStarted","Data":"4319585b075e5e88d37a59a9fe21cf6657490daab8e25b92451f33a70dbb8739"}
Jul 21 02:26:36.441673 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:36.441622    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg" podStartSLOduration=1.441607871 podStartE2EDuration="1.441607871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:26:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:26:36.440048477 +0000 UTC m=+1964.181854830" watchObservedRunningTime="2026-07-21 02:26:36.441607871 +0000 UTC m=+1964.183414212"
Jul 21 02:26:36.694648 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:36.694566    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/2.log"
Jul 21 02:26:36.701753 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:36.701728    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-55b6r_ef8eddcb-07b1-4bc7-8582-5d5df19edf5e/console-operator/3.log"
Jul 21 02:26:37.208941 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:37.208903    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dd858f6c6-pjspw_1734d58b-5bc2-4e34-b58a-da006646cde0/console/0.log"
Jul 21 02:26:37.250624 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:37.250592    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-pdbsk_29b3c37d-22e7-4267-9de2-7c2a38c15bba/download-server/0.log"
Jul 21 02:26:39.136906 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:39.136875    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4fw89_928398f5-9efb-4fe2-9e95-4493538183e9/dns/0.log"
Jul 21 02:26:39.160873 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:39.160850    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4fw89_928398f5-9efb-4fe2-9e95-4493538183e9/kube-rbac-proxy/0.log"
Jul 21 02:26:39.338554 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:39.338520    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9vvff_117814c7-fce9-4cd1-be4c-6763b7bc01f7/dns-node-resolver/0.log"
Jul 21 02:26:40.011393 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:40.011353    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8549s_9c6997aa-dcff-43e1-83f9-d0e1dcf2ae42/node-ca/0.log"
Jul 21 02:26:41.165901 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:41.165871    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b99b8fb9b-6247r_1ee0ba38-d648-4ffe-8f17-cad090e04748/kube-auth-proxy/0.log"
Jul 21 02:26:41.296920 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:41.296882    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fbd99_bd129f2f-ec2c-4f40-8620-2a4078e4530d/payload-pre-processing/0.log"
Jul 21 02:26:41.336910 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:41.336881    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-56kvv_2f9ee006-33c0-463b-8d7b-1fd4cd83cde6/payload-processing/0.log"
Jul 21 02:26:41.361928 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:41.361900    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69778848fd-sbjnc_f7ef1d90-623b-49cf-92d0-7d85ca88d545/router/0.log"
Jul 21 02:26:42.014262 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.014216    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cpswz_9e26a01e-f32f-4d79-9b03-115e2e69d208/serve-healthcheck-canary/0.log"
Jul 21 02:26:42.427202 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.427116    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tvkpq/perf-node-gather-daemonset-pfkbg"
Jul 21 02:26:42.674298 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.674255    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jzr2d_19affe16-d907-4db5-8431-8f79c72b7ad9/insights-operator/1.log"
Jul 21 02:26:42.674501 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.674445    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jzr2d_19affe16-d907-4db5-8431-8f79c72b7ad9/insights-operator/0.log"
Jul 21 02:26:42.700203 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.700136    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xsbz_236124bb-f4fe-4899-a8f1-4c8be275ba61/kube-rbac-proxy/0.log"
Jul 21 02:26:42.723735 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.723713    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xsbz_236124bb-f4fe-4899-a8f1-4c8be275ba61/exporter/0.log"
Jul 21 02:26:42.747657 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:42.747629    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xsbz_236124bb-f4fe-4899-a8f1-4c8be275ba61/extractor/0.log"
Jul 21 02:26:45.648712 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.648677    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-94m2r_bb330596-015e-4e7b-8640-9ea6c9c83891/manager/0.log"
Jul 21 02:26:45.756951 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.756920    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2p7t7_d1b48bfc-96e1-4d66-85b4-17841b902ff1/manager/0.log"
Jul 21 02:26:45.854343 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.854300    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54fc764664-vk6wf_51ad44f8-a820-4294-9fbe-c5a232d9a559/manager/0.log"
Jul 21 02:26:45.881567 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.881544    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zltrl_0ee16ecc-c0f3-44ac-aa4a-68c09a1f12f4/server/0.log"
Jul 21 02:26:45.884882 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.884856    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b99b8fb9b-6247r_1ee0ba38-d648-4ffe-8f17-cad090e04748/kube-auth-proxy/0.log"
Jul 21 02:26:45.958415 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.958321    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fzbtc_4633258f-49d6-4967-8739-04527475dd1f/manager/0.log"
Jul 21 02:26:45.990476 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:45.990445    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fbd99_bd129f2f-ec2c-4f40-8620-2a4078e4530d/payload-pre-processing/0.log"
Jul 21 02:26:46.017172 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:46.017137    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-56kvv_2f9ee006-33c0-463b-8d7b-1fd4cd83cde6/payload-processing/0.log"
Jul 21 02:26:46.037556 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:46.037533    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69778848fd-sbjnc_f7ef1d90-623b-49cf-92d0-7d85ca88d545/router/0.log"
Jul 21 02:26:46.167066 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:46.167030    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c97f6b6f9-n22sn_8a3c4d29-ab23-4a26-9672-efd214c79e2a/manager/0.log"
Jul 21 02:26:46.199848 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:46.199825    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c97f6b6f9-n22sn_8a3c4d29-ab23-4a26-9672-efd214c79e2a/copy-manifests/0.log"
Jul 21 02:26:47.273937 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:47.273892    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b99b8fb9b-6247r_1ee0ba38-d648-4ffe-8f17-cad090e04748/kube-auth-proxy/0.log"
Jul 21 02:26:47.389107 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:47.389074    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fbd99_bd129f2f-ec2c-4f40-8620-2a4078e4530d/payload-pre-processing/0.log"
Jul 21 02:26:47.420288 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:47.420263    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-56kvv_2f9ee006-33c0-463b-8d7b-1fd4cd83cde6/payload-processing/0.log"
Jul 21 02:26:47.438517 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:47.438490    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69778848fd-sbjnc_f7ef1d90-623b-49cf-92d0-7d85ca88d545/router/0.log"
Jul 21 02:26:47.543049 ip-10-0-141-1 kubenswrapper[2574]: I0721 02:26:47.542974    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-r6vdf_e82d7aa3-369a-4dc0-a5da-000d04cbd1b9/openshift-lws-operator/0.log"